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Putting people into armor development 

Robert W Bauer 


The life cycle oystom mnnaqoment model used by 
the Army in developing mnior now weapons requires 
that logistics, personnel, and training subsystems be 
developed simultaneously with hardware. To better 
understand tho systoms integration process, the Army 
Research Institute studied the development of the Ml 
tank. Revealing some important discrepancies be¬ 
tween theory and practice in applying tho model, ARI's 
resoarch suggests that altomntivo procedures might 
more elloctivoly accommodate logistics, manpower, and 
training issues in weapon systems development. 



Are other acquisition strategies 
superior to the P 3 I approach? 


Frederick P. Biery 


Defense policymakers have been searching for ways 
to reform procurement strategy in an effort to arrest tho 
time-cost spiral that has come to chaiaclorize weapon 
system development. One approach that has gained 
broad suppoit is preplanned product improvement, or 
PY This article, based on an analysis of existing mod¬ 
ification programs, suggests that P :, l is not likely to meet 
expectations. The author proposes a combination ol 
procurement strategies, such as increased competition 
and short-range preplanning, as a more workable al¬ 
ternative. 



What are the incentives 
in incentive contracts? 


Dan C. Boger, 

Carl R. Jones 
and 

Kevin C. Sontheime r 


In the early 1960s the Department of Defense in¬ 
creased its use of incentive contracts in an effort to 
encourage contractors to control the costs of procure¬ 
ment contracts. But a model described in tins article 
demonstrates that certain combinations ot cost-shoring 
and incentive fee proposals can actually create incen¬ 
tives for cost growth. In addition, the model offers a 
quantitative method for determining the amount by which 
a cost-sharing ratio should be increased in order to 
avoid incentives for the contractor to incur convenience 
costs. 



Property rights and the cost growth 
of weapon systems 


Harold J. Brunvn Jr. 


The rising costs of weapon system procurements 
have been the subject of intense debate and scrutiny 
lor many yoars. Attempts to bring these costs under 
control, however, have been less than successful. This 
article suggests that the difficulty may dorive in part 
trom inadequate attention to the property rights struc¬ 
ture within the Department of Defense. That structure, 
the author argues, exerts great influence on organi¬ 
zational behavior and is critical to understanding the 
motivation of decisionmakers within DoD. 
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A clear, simple guide 

to weapon system troubleshooting 


Barry S. Cosset 
and 

Stephen H. Waters 


As weapon systems grow m complexity, maintaining 
them increasingly becomes a job for skilled technicians. 
Unfortunately, experienced, highly trained mainte¬ 
nance personnel are in short supply. In developing trou¬ 
bleshooting procedures for the U S. Roland program, 
logistics engineers at Booing devised an approach that 
is quick, easy to use. and cost-ctlective. As described 
in this article, the approach allows technicians at all 
skill levels and with varying degrees of system knowl¬ 
edge to raoidiy troubleshoot a complex systom without 
extensive training 


Performance-based monetery rewards 
can boost indtvidual productivity 


E. Chandler Shumate, 
Steven L. Dockstador, 
and 

Delbert M. Ncboker 


In 1975 the Navy Personnel Research and Devel¬ 
opment Center began a series of studies dealing with 
motivational techniques designed to enhance worker 
productivity. Roscarchers subsequently found that one 
technique, a performance-contingent roward system, 
led to significant productivity improvements among key 
entry operators at the Long Beach and Ma r e Island 
Naval Shipyards. In this article, the authors describe 
the manner in which the studies wore conducted and 
highlight various data reflecting the productivity 
achievements. 


Sharing human intelligence 
^•WMm through a computer network 

Robert J. Knez 


The use of computers today extends to a mind-bog¬ 
gling variety of applications, ranging from information 
retrieval and electronic mail to word processing and 
other office automation services Hero the author sug¬ 
gests yet another far-reaching application: a computer 
lime-sharing network to promote tho cross-fertilization 
of ideas among managerial subscribers from many dis¬ 
ciplines. Known as Consultants Anonymous, the pro¬ 
posed network could be used by project planners, for 
example, who are seeking to verify tho completeness 
of activity lists or the correctness of an event sequenco 
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Putting people 
into armor development 

By ROBERT W. BAUER 

According to the author , research on the Ml tank suggests that the Army’s 
life cycle management model is unrealistic in its expectation that training 
and other requirements can be developed simultaneously with hardware. 


I n 1979 and 1980, the U.S. Army Research Institute 
for the Behavioral and Social Sciences initiated audit 
traces of several important Army development projects. 
The goal of the audits was to gain a better understanding 
of the factors involved in integrating people into new 
weapon systems developments. With the cooperation 
of the U.S. Army Training and Doctrine Command’s 
system manager for the Ml tank (then the XM1), AR1 
selected that system for examination’because it exem¬ 
plified a new approach to development, placing much 
more responsibility on the contractor than in the past, 
and also because it was a highly visible major system. 
The choice may also have been influenced by the fact 
that the Ml is one of the more successful recent Army 
developments. While examining the lessons learned and 
presented here, it is important to note the overall suc¬ 
cess of the Ml development. 1 

In theory, the life cycle system management model 
used in developing the M1 is event-driven in accordance 
with regulations and acquisition guidance: earlier mile¬ 
stones must be met before moving on to later mile¬ 
stones. In reality, the program was time-driven by sys¬ 
tem performance requirements and cost and schedule 
constraints. The highest levels of management in the 
Department of the Army, the Department of Defense, 
the Office of Management and Budget, and Congress 
concentrated on performance, cost, and schedule as 
the most critical measures of program success, and 

1 Most of the data and conclusions in this article are taken 
from J. J. Kane, Personnel and Training Subsystem Integra¬ 
tion in an Armor System, Research Report 1303 (Washington, 
DC: U.S. Army Research Institute for the Behavioral and So- 


Army acquisition managers responded in kind. 

The audit trace of personnel and training subsystems 
development indicated that in the effort to keep the 
program on schedule and to contain costs, “people” 
development milestones were sometimes checked off 
when in fact they were not completed. People-related 
development lagged behind materiel from the time of 
the decision to omit the integrated logistic support pack¬ 
age front the advanced development contracts for dem¬ 
onstration and validation. As the project manager for 
the XM1 noted, "This decision to omit integrated lo¬ 
gistics support resulted in logistical support develop¬ 
ment lagging development of the tank by one phase at 
the time of full-scale engineering development contract 
award.” 2 

Postponement incant that an integrated logistic sup¬ 
port package could be prepared during full-scale en¬ 
gineering development for only the surviving contender 
in the competition, thereby saving time; nonetheless 
the lag persisted. For example, the final qualitative and 
quantitative personnel requirements information and 
the final military occupational skill decisions, which were 
checked off on schedule, were actually delayed until 
after initial production. Delays in hardware develop¬ 
ment similar to these delays in logistics, personnel, and 
training events would have been unacceptable. 

Three assumptions guided ARI’s audit trace: 

• The life cycle system management model is dc- 

2 Letter from Colonel H. J. Velort, Deputy Project Manager, 
XMI, to Major General Alan A. Nord, USA, January 26, 
1979, subject: LEA XMI ILS Program Review (Draft), 2 Jan¬ 
uary 1979: Summary of XMI PMO Staff Comments, p. 1 of 





• i iic mouui is imenucu 10 proviue aeainue, nmeiy 
data lo decisionmakers in the Army. PoD, the Office 
of the President, and the Congiess. 

• Deviations from the model's procedures and the 
effects of those deviations would he of interest to proj¬ 
ect and system managers. 

The scope of the audit trace included only the period 
of development Irom milestone I) to Army Svstem Ac¬ 
quisition Review Council milestone 111 and did not in¬ 
clude all of the production and deployment phase 

The approach used in analyzing the case was an ad¬ 
vocacy method designed to simulate organizational in¬ 
teractions. The organizations involved in the Ml de¬ 
velopment were divided into six groups, each representing 
a different organizational perspective (see Figure I). 
One researcher or advocate traced the activity of each 
group and represented its perspective and experience. 

AR1 also assembled a hoard of highly experienced 
senior scientists to role play upper-level Army and DoD 
management and to represent the total systems view¬ 
point. This board received briefings from the advocates, 
reviewed the overall progress of the case study, and 
provided guidance to the research team. 

The model 

The life cycle system management model comprises 
five phases (sec Figure 2): 

• The first phase involves approval of the mission 
element need statement and now also includes appoint¬ 
ment of a system manager from the Army's Training 
and Doctrine Command (appointed later in Ml devel¬ 
opment). 

• The second phase is an exploration and identifi¬ 
cation of alternative system concepts, including those 
for logistics, personnel, and training. Toward the end 
of this phase, the decision on demonstration and vali¬ 
dation is made, a project manager is appointed, and a 
draft decision coordinating paper is approved by the 
Secretary of Defense. When this paper was approved 
for the XM1 in January 1973, it gave the newly ap¬ 
pointed project manager seven years from that date to 
begin production. 

• The third phase for the XM1. demonstration and 
validation (formerly called advanced development), 
included competitive contract awards to General 
Motors Corporation and Chrysler Corporation for 
production of prototype weapons, which were tested 
later that same year. The third phase also normally 
includes approval of a training device requirement 
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• The fourth phase, full-scale engineering ik\C‘ 
ment, consists of additional development .un! tv’.' 
and Army and Defense System Acquisition 1-Uu. 
Councils II. For the XM1, the contract uw.ird < nr. 
ler initiated this phase, which also included Jo.-i •. 
mem test II and operational test II. tm.d ivi'.-n 
requirements information, the MOS devi'S'ii .m.l 
logistic support analysis. 

• The fifth phase, production and depUwmvitt d 
cision, included ASARC 111 and DSA1U 111. in i! 
case of the XM1, it was concurrent with .i dtU'i.-n t 
enter low-rate initial production. 


Ml personnel and training subsystems 

As the project manager pointed out latu tin \NT 
development represented a new approach In thv y • 
we just sort of fitted the pieces together I here u.i* r 
real, from-thc-ground-up thought process I ruditin 
ally, he went on to say, “Development h.i> Kvu uu* 
ated by an in-house philosophy that ropMcd ilu- i,l • 
that industry should have a part in this,"' I lH.vi.wr t) . 
Main Battle Tank Task Force, which comciu dm 1 r 
Knox, Kentucky, in February 1972. recount/*.<1 the ik,.: 
for increased contractor responsibility tor s\M.-ni,k■* •„ 
and integration. The task force idenuiied II d.'i;.. 
characteristics and listed them in order o! / 

’ Quoted in Uric C. Ludvigien, "X Ml . m - ■. H. 
Strong Impact on Future Ground Forces. " Aiii.', M •. 
February 1976. pp. 37-35. 
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priority for the advanced development phase. Among 
the characteristics were erew survivability (third in 
priority) and human engineering (ninth). 

In mid-1975. the Tank Special Study Group, orga¬ 
nized at Fort Knox by TRADOC's commanding gen¬ 
eral, elevated erew survivability to first priority. This 
group placed additional emphasis on system ehaiacter- 
istics involving human pot formance, assigning second 
priority to surveillance and target acquisition perform¬ 
ance, lor example; third priority to first- and second- 
round hit probability, and twelfth priority to human 
factors. Its list numbered 10 characteristics. 

To address human factors in the engineering devel¬ 
opment phase, Chrysler established both a human fac¬ 
tors engineering program and an engineering-system 
safety group. The Army's Human Engineering Labo¬ 
ratories and its Medical Research and Development 
Command regarded this contractor effort as very suc¬ 
cessful. 4 They concluded that in spite of some deficien¬ 
cies, the design of the XMI was probably the best from 
a human factors standpoint of any American fighting 
vehicle in the current inventory. 

Logistics problems. The logistics arena fared less well. 
Advanced development contracts for the XMI did not 
require development of integrated logistic support 
packages forevaluation at development and operational 
test I. The rationale was that two such packages in the 

' U.S. Army Human Lnfiineering Laboratories and Medical 
Research and Dnelopment Command, "Human Taciors En¬ 
gineering Analysis (Jll-'LA) for XMI Tank System ASAliC 


competitive phase would be redundant and that cost 
savings could therefore be realized by waiting until lull- 
scale engineering development. 

To further reduce costs, the Army decided to require 
during engineering development neither a full logistic 
support analysis nor a logistic support analysis record, 
intended to identify and quantify logistic support re¬ 
quirements for materiel development. As a result, re¬ 
quirements for integrated logistic support were not met 
and the delivery of such support, including personnel 
and training packages, fell back by one phase. 

The gap between hardware development and logistic 
support development widened luither due to the proj¬ 
ect manager’s decision to permit extensive contractor 
involvement in maintenance during operational test II. 
Since contractor personnel did much of the mainte¬ 
nance, the data available on maintenance performed 
by soldiers were very limited. The director of supply 
and maintenance for the Army's Deputy Chief of Staff 
for Logistics expressed his concern, and in Ithat 
office directed its Logistics Evaluation Agency to do an 
interim assessment in preparation for the low-rate initial 
production decision. 

The Deputy C hiefs of Staff for both Personnel and 
Logistics were reluctant to become involved early in the 
development because the Army had not funded an in¬ 
tegrated logistics support package as part of the initial 
XM1 program. Also, they were aware that the hardware 
eoneept was rapidly changing and that data on soldier 
performance wore lacking. 
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analysis unci review during full-scale engineering de¬ 
velopment. Therefore, it is doubtful that the Army ac¬ 
tually saved costs by these early reductions. 

Rather, these may have been costly decisions, a view 
supported by the Tank Forces Management Group, 
whose report criticized tank project managers for de¬ 
laying integrated logistics support planning: “This strat¬ 
egy makes it impossible to develop complete logistic 
and training suppoit packages for operational test II,” 
and as a result, ‘’delays a full production decision, an 
expensive proposition. Thus, the front-end cost savings 
achieved by delaying integrated logistic support plan¬ 
ning arc lost when the effects of that strategy cause 
production delays later in the program.” 5 

In retrospect, it is easy to see that greater interest in 
integrated logistics support early in the program would 
have made managers aware—before 1979—that a 1500- 
horsepower engine in the Ml (whether turbine or die¬ 
sel) versus a 750-hotsepower engine in the M60A1 would 
require more fuel trucks and more truck drivers. Some 
of the impact of new components on maintenance per¬ 
sonnel could also have been anticipated. 

Manpower requirements. As in the case of logistics, 
difficulties in identifying manpower requirements ac¬ 
tually derived from several earlier problems and deci¬ 
sions. The first maintenance test sets, for example, which 
were evaluated in a special maintenance evaluation in 
February and April 1978, had severe reliability prob¬ 
lems; consequently, the troubleshooting manuals based 
on their use were invalid. Due in part to this problem, 
annual maintenance man-hours were obtained in nei¬ 
ther the evaluative physical tcardown nor in operational 
test 11 carried out in 1978-1979, when contractor per¬ 
sonnel did much of the maintenance. Failure to collect 
these data resulted in very speculative annual mainte¬ 
nance man-hour estimates based largely upon M60A1 
experience; delays in final MOS decisions thus persisted 
into 1979. 

The failure to gather maintenance data based on sol¬ 
dier experience in operational test 11 in turn affected 
the qualitative and quantitative personnel requirements 
information document, which the Training and Doc¬ 
trine Command was to have submitted to Army head¬ 
quarters in September 1977. Subsequently changed to 
August 1978, that submission date was not met cither, 


5 /.loi/eanm General James Kalergis, USA (liel.), e\ nf., A 
Program for Maximum Effectiveness . . . Tank Weapon Sys¬ 
tem Management, Tank Forces Management Group, The Pen¬ 
tagon, Washington, DC, Undated (at. August 1977), p.V-17. 


all affected parties. Both the Ordnance and Chemical 
Center and School and the Logistics Center, for in¬ 
stance, found the information in it insufficient for their 
purposes/’ 

fn July 1977, the Military Personnel Center initiated 
a requirement for an initial recruit and training plan for 
systems acquisitions. The plan for the XM1, which had 
been selected as n test case for the requirement, was 
published in October 1977 and revised in March 1978. 
Though the project manager’s office admitted that an¬ 
nual maintenance man-hour data on the XM1 were in¬ 
sufficient, it urged approval of a final personnel re¬ 
quirements document in 1979 so that the XMI program 
could be kept on schedule. That final report was based 
upon MCOAl data, but the 1979 update of the initial 
recruit and training plan acknowledged that in fact “lo¬ 
gistic supportability, ammunition and fuel, together with 
proposed changes in support doctrine, will necessitate 
a large manpower increase.” 7 

Training requirements. Problems related to training 
surfaced as well. In preparing for ASARC milestone 
III, the Logistics Evaluation Agency did an interim lo¬ 
gistics assessment of the XMI which identified three 
critical skills; fire control computer repairman, vehicle 
mechanic, and turbine engine repairman. The agency 
concluded that additional duties for individuals in the 
first and second groups would be too much for these 
personnel to handle and, while noting favorably the 
XMI system manager’s efforts in logistic suppoit de¬ 
velopment, training, and logistic test evaluation, also 
commented on the complete lack of diagnostic test sets 
and the resulting adverse impact on maintenance train¬ 
ing programs. The same interim assessment recorded 
the significant lag in training devices and the failure to 
validate the training manuals. 

After reviewing the Logistics Evaluation Agency po¬ 
sition and the logistics readiness review prepared by the 
Materiel Development and Readiness Command, the 

0 (/..S'. Army Ordnance and Chemical Center and School 
Memorandum. March JO. 1978, subject: Amended Qualitative 
and Quantitative Personnel Requirements Information 
(AQQPR1) for XMI Tank, Combat, hull Tracked. Nfi'TP No. 
TAR-7; Logistics Center Memorandum LOGC May 3, 1978, 
subject: Amended Qualitative and Quantitative Personnel Re¬ 
quirements Information (AQQPR1) for XMI Tank, Combat, 
Full Tracked, NETT No. TAR-7. 

1 Military Personnel Center, "Military Personnel Center Ini¬ 
tial Recruit and Training Plan for XMI Tank System (U),'' 
Alexandria, VA, May 31, 1979 (Updated June 20, 1979) 
(CONFIDENTIAL). Tab R. 
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istics Evaluation Agency noted that introducing 
ling devices after fielding would create “turmoil.” 
ugh revised materiel need documents had called for 
current development of tank and training devices 
i testing of the training devices during operational 
II, the project manager's office asserted that “it 
never planned to have prototype training devices 
lable for development and operational test II” and 
stated that “the XM1 training devices, while highly 
rablc, are not essential to operational test Hi in 
) or fielding in 1981 

dy In contrasting views 

he history of the development of XM1 training de- 
requirements and training devices is a study in 
rusting views within TRADOC. in the concept phases 
Tank Special Study Group took the position that 
training devices had to be developed concurrently 
the XM1. it called for delivery of production models 
ioth the driver trainer and conduct-of-firc trainer 
»re development and operational test II; evaluation 
icse two devices to proceed concurrently with that 
. and delivery of the organizational, direct support- 
eral support, and full crew devices before devcl- 
tent and operational test Hl. y 
he original XM1 master schedule called for TRA- 
C to submit training device requirements to Army 
Jquarters in May 1974. Although the command was 
able to achieve agreement by that date, the Army’s 
tor School did forward proposed requirements in 
' 1974, which included a tank driver trainer, turret 
ler, and a turret repairman maintenance trainer, 
✓ever, TRADOC’s deputy for training wanted more 
•vative thinking that would employ the latest in sim- 
ion technology. He was particularly interested in 
•in electronic and computer-connected devices which 
Id give personnel access to computer-generated im- 
y simulation in a very physically constrained en- 
nment. 

. late 1974, the XM1 program manager urged the 
ning and Doctrine Command to come to an ex- 
tious decision on the XM1 requirements. Following 
command’s reply that the decision would be delayed 


,etter from Colonel H. J. Vetorr, op. cit. 
n ank Special Study Group, User Review and Analysis of 
•1 Tank Requirements Documentation, Vol. Ill, "Re- 
menls Review (U), ” U.S. Army Armor Center, Fori Knox, 
June 30, 1975, p. 12-5. 


engineering development. He also needed Department 
of the Army approval by December 15, 1975, to meet 
FY 1977 budget deadlines. The Training and Doctrine 
Command did not respond in time to meet either dead¬ 
line. 

In April 1976, TRADOC reached agreement with 
the Materiel Command to fund training device devel¬ 
opment. TRADOC also undertook several studies in 

1976 to analyze device feasibility and effectiveness. When 
the demonstration and validation phase on the XM1 
ended in July of that year, development work under 
the letter of agreement was still in progress, and it be¬ 
came obvious that the training devices would not be 
available for XMl operational test II. Instead, it was 
proposed that device prototypes be ready for training 
personnel at operational test III. TRADOC developed 
a set of draft training device requirements and in July 

1977 submitted them to Army headquarters, which ap¬ 
proved them in late 1977. 

At this point, the training device requirements were 
approximately three and one-half years tate. The report 
from the Tank Forces Management Group cited frag¬ 
mented responsibility for tank training devices and 
TRADOC’s failure to submit timely requirements in¬ 
formation as contributing factors. ,f> Because of these 
delays, the first conduct-of-fire trainer was not sched¬ 
uled for delivery until a year after XMl fielding, and 
the first one-station unit trainer would not be available 
until at least 3 years after the start of institutional train¬ 
ing. 

In theory, the Training and Doctrine Command, as 
the proponent, is the driving force behind the Army’s 
system acquisition cycle. New programs are initiated 
based on its continuing analysis of mission needs, and 
programs are continued based on its refinement of re¬ 
quirements and evaluation of effectiveness. However, 
once a program has begun, the Materiel Development 
and Readiness Command’s project manager is in charge, 
and that command’s hardware development paces the 
schedule. 

The project manager is not always able to respond 
to TRADOC’s problems. For example, the XMl man¬ 
ager could not provide enough tank prototypes to sup¬ 
port the development and validation of training mate¬ 
rials and devices. When a twetfth tank could not be 
built for operational test II, the requirement for vali¬ 
dation of the integrated technical documentation and 

m Lieutenant General James Kalergis, USA (Ret.), et al., 
op. cit., p. V-19. 


UlU lilt 


Is concurrent development possible? 

Perhaps concurrent development of hardware and 
training materials and devices is simply not possible. 
Project managers for both the XM1 and the fighting 
vehicle systems have recently stated that they believe 
some incoordination is inevitable. A collapsed devel¬ 
opment schedule, such as the 7-year XM1 schedule, 
creates an environment of rapid change. Development 
and operational tests often proceed simultaneously; en¬ 
gineering changes in hardware take place even during 
user testing; and user test crews and maintainors are 
introduced to new components frequently. Even if a 
prototype could be delivered on time, evaluating n 
training device might prove difficult under such circum¬ 
stances. Training manuals are also usually undergoing 
rapid change. The new equipment training experience 
is sometimes used to correct and update preliminary 
manuals and to reconsider training requirements and 
innovations as well. 

In addition, during XM1 development the newly or¬ 
ganized Training and Doctrine Command was intro¬ 
ducing innovative ideas and practices. The system man¬ 
ager concept, skill performance aids, high technology 
training devices, and cost and training effectiveness ana¬ 
lyses were all among them. In part, the command’s 
difficulties in developing training device and personnel 
requirements were due to internal ^organizational ef¬ 
forts—ironically, undertaken to improve consideration 
of personnel and training factors. 

The XM1 project manager's drive to achieve sched¬ 
ule. cost, and performance goats, whether or not a mile¬ 
stone was slipped, are readily understandable in the 
historic and economic context of major weapon system 
development. Scheduling delays of the materiel system 
were almost certain to involve increased costs and un¬ 
favorable attention from the U.S. General Accounting 
Office and the executive department, with associated 
risks to the whole program. 

Clearly, the divergence between the theory and the 
reality of the life cycle system management model is 
too great in the personnel and training areas. In a recent 
report for the Army Materiel Systems Analysis Agency, 
General Walter T. Kerwin, who served as chairman of 
the council for ASARC milestones II mul III, stated 
that the model needs more discipline with respect to 
manpower, personnel, training, and logistics issues. 
“Initial operational capabilities and compression of the 
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support is deferred, the manpower, personnel, training, 
and logistics issues suffer.*’ n 

The current model requires that training device re¬ 
quirements bo passed on to the device developer at a 
stage where there are still very high risks of significant 
design changes. Risk of training device invalidation is 
necessary if the device is to be available when the weapon 
is first issued. The XMI maintenance diagnostic sim¬ 
ulators illustrate the risks posed. When these test sets 
did not perform well in development test and opera¬ 
tional test II, a nearly complete set of maintenance 
trainers was invalidated. 

As suggested earlier, delays in areas such as crew 
simulator training development were not attributable 
to changes in the XMI design so much as to changes 
going on within the Training and Doctrine Command 
itself. That the delay of several years in crew simulator 
training did not cause greater concern to upper level 
managers of the XMI development supports the view 
that the life cycle system management model is un¬ 
realistic in requiring training device development si¬ 
multaneous with hardware development. IT, indeed, 
training device requirements cannot be realistically de¬ 
termined prior to operational test II, then the require¬ 
ment to deliver prototype devices for evaluation at sys¬ 
tem operational test II should be eliminated from the 
model. 

A more gradual and evolutionary introduction of 
training during the early period of production and de¬ 
livery may be in order. Though the Army’s Operational 
Test and Evaluation Agency was designated as opera¬ 
tional tester of the XMI system, that agency did not 
have responsibility for testing training devices or train¬ 
ing. Instead, TRADOC is designated operational train¬ 
ing developer and tester for training devices, even though 
evaluation of the capability of trained personnel is part 
of the operational testing phase. 

Aliernative procedures 

As an alternative to current practices, TRADOC could 
evaluate training systems and devices during the force 
development testing and experimentation. Also worth 
considering is a development test for training devices. 

11 General Waiter T. Kerwin, USA, General George S. Blan¬ 
chard, USA, Erwin M. Atzlnger, and Phillip E. Topper, "Man- 
Machine Interface—A Growing Crisis," d»mv Materiel Sys¬ 
tems Analysis Agency, Aberdeen Proving Ground, MD, Au¬ 
gust 1980. 


n major systems. Moreover, assigning respon- levels ol the Army. Department of Defense, and Con¬ 
or both developing and testing training systems gress. If documents such as the selected acquisition ic¬ 
ier command, such as the Deputy Chief of Staff views and the Army program reviews incorporated per- 

;omiel, with the Training and Doctrine Com- sonnel and training milestones and objectives, these 

; a participant, would be more consistent with would receive high-level review similar to that accorded 

cept of independent evaluation. In any ease, hardware developments. The likelihood of more timely 

bility for evaluation must be clearly assigned accomplishment and higher quality would be substan- 

nrly planning for training support development, tially increased. 

.lition, better manpower and logistics estimates The Army experience with XM1 development points 
nadc early in development. Areas for improve- upbothstrengthsand weaknessesmthecurrcntlyevolv- 

:ludc communication between the project man- ing system for manpower, personnel, and training de- 

ffice and the logistic agencies responsible for vclopmcnt in a major new- weapon life cycle. The Train¬ 
ed logistics support development, and the tim- ing and Doctrine Command’s system manager is able 

nidation of support package developments in to expedite the development of manpower, personnel, 

:e of the Army’s Deputy Chief of Staff for Lo- and training products only insofar as responsibilities are 

the Deputy Chief of Staff for Personnel, and dearly allocated. To be effective, that system manager 

DC. Clearly establishing responsibilities for dc- must also coordinate closely with the project manager, 

Jilt and delivery schedules is very important, whose level of involvement in human resources has im- 

dbility for human resources development can portant consequences. In addition, the prime contractor 

alized in the project manager's office, as was can he required to provide human factors and training 

the relatively successful development of the developments, but only if the contract specifications are 

'f target acquisition system. In that develop- well defined. 

deputy project manager served as focal point Integrated logistics support and manpower, person- 
an resources issues. nel, and training developments are interdependent; dc- 

r the compressed schedule, the time between lays in one seriously impede the other. Some time re¬ 
mem and operational test 11 and ASARC 11! is quirements of the life cycle system management model 

lot sufficient for completing key events relating may be unrealistic. For example, a longer lag between 

ualitative and quantitative personnel require- training and training device development on the one 

tegration document, basis of issue, and training hand, and hardware development on the other, may be 

on. Since those products require the data gath- unavoidable. Realistically, development and testing of 

ing development and operational test II, some training and training devices is likely to continue for 

al time for analysis and review prior to ASARC some time after initial operational capability, 

be allowed. Similarly, the time lapse between More reasonable and explicit recognition of people 

nient and operational test 1 and ASARC II may integration in the project manager's planning and budg- 

be increased if the intervening milestones are eting. plus greater visibility for manpower, personnel, 
eomplishcd. training, and logistics developments in reports to upper- 

ower, personnel, and training issues need greater level Army and Defense Department management, will 

n and priority in both the Army and Defense do much to improve the integration of people into new 

Acquisition Review Council processes. The rel- Army systems. 

nphasis upon hardware, cost, and scheduling __ 
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Are other acquisition strategies 
superior to the P 3 ! approach? 

BY FREDERICK P. BIERY 

Experience suggests that the answer to DoD’s procurement problems 
may lie in a combination of techniques rather than a single-policy approach. 


T he escalating costs of new weapons, ever- 
lengthening acquisition cycles, and other wor¬ 
risome trends in recent years have disturbed many 
defense analysts. They note that while the typical 
fighter aircraft of the 1950s cost $4 million in 1975 
dollars, the average cost of a fighter in the 1970s, 
as measured in same-year dollars, had nearly tri¬ 
pled to $11.7 million. During the same two dec¬ 
ades, the typical procurement cycle—the period of 
time between issuing a requirement for a new 
weapon and fielding the system—had stretched to 
10 years. 

Unstable procurement budgets, which fluc¬ 
tuated considerably in the 1970s and rarely sus¬ 
tained any real increases, further aggravated weapon 
cost escalation. These various factors also led to 
the steadily rising age of U.S. military equipment. 
The average age of Air Force tactical aircraft, which 
was 3 years in 1960, had doubled by 1970, reached 
8 years in 1980, and is expected to be 10 years by 
1985. 

Not surprisingly, defense analysts have been 
searching for ways to arrest these negative cost, 
time, and budget trends. They realize that to re¬ 
duce the average age of the Air Force inventory 
to 5 years, for instance, DoD would have to pur¬ 
chase at least 600 aircraft each year. But the es- 


is the preplanned product improvement strategy, 
or PM. It is one of the key weapon system acqui¬ 
sition reforms initiated by former Deputy Secre¬ 
tary of Defense Frank C. Carlucci and has been 
praised by defense analysts and industry repre¬ 
sentatives alike. General Accounting Office ana¬ 
lysts view the concept favorably, as do congres¬ 
sional officials. 

But while the theory has been endorsed and 
ensconced as policy, it has received little detailed 
analysis. Discussion of the concept’s advantages 
and disadvantages continues to be abstract and 
theoretical, and P 3 1 has yet to show its metal by 
being successfully applied to a major weapon sys¬ 
tem . To determine what benefits might realistically 
be expected from PM, this article will review the 
theory in light of past experience in weapons mod¬ 
ification and improvement. It will also consider 
other strategies that might successfully reverse re¬ 
cent trends in weapon systems acquisition.* 

Preplanned product improvement was rapidly 
endorsed because it appears to offer a solution to 
the problems of high costs and long lead times in 
weapon systems procurement. It proposes to do 
so by systematically incorporating capability im- 

* This article draws on material from Frederick P. Biery and 
Mark Lorell, Pre-Planned Product Improvement and Other 






provements and modifications over the course of 
a system’s life. Rather than starting a new program 
to meet new needs and threats, PM would upgrade 
weapons in the inventory. Modifying systems al¬ 
ready in the inventory is currently a multimillion 
dollar a year activity, arvd programs such as the 
M60 tank and the F-4 fighter have undergone many 
modifications in their lifetimes. But those urging 
preplanned product improvements view it as a new 
and fundamentally different acquisition strategy, 
one quite different from current modification prac¬ 
tices. 

First, proponents characterize PM as a strategy. 
It offers a coherent plan for multiple system up¬ 
grades well into the future rather than a series of 
ad hoc modifications proposed and implemented 
as the need arises. Ad hoc programs, such as the 
improvements made over the years to the B-52 
bomber or A~7 aircraft, have not followed a sys¬ 
tematic, lifelong improvement plan. Modifications 
are generally reactions to new technology, threats, 
or user needs, and are not part of a multiyear, 
multiphase improvement plan established when the 
system was designed. 

Preplanning is the second distinguishing feature 
of the approach. Supporters believe that a PM sys¬ 
tem, designed from its origins to accommodate 
long-term improvements, should provide signifi¬ 
cant advantages over a conventionally designed 
weapon system, for which modifications are not 


pie; in new weapon ucveiupiiwm 
Figure 1). Reducing the technological a gen 
ness of weapon development program'' i. 
lowers the risk of cost growth and schedu' 
page. 

Traditional, ad hoc modification program- „ 
erally take less lime to complete and as a ru‘. 
less than does development of a new sv-oeii: i 
ponents of preplanned improvements expsv • 
ilar results; indeed, they foresee even better r- 
from preplanned systems. While a I’M sw,. 
likely to offer less capability and performance • • 
a new weapon development program, us 
pated lower costs and faster completion lime 
offset this disadvantage. 

These hypothesized advantages arc signd:. 
and clearly make PM an attractive strategy 
sue. However, the costs and benefits arc uucon 
and important questions of feasibility anil u: .• 
mentation remain. For example, how should : - 
weapons designer proceed? How can prepla*** 
be incorporated into the source selection pns.\. • • 
What kinds of systems should be selected as ^ 
didates? 

Partial answers to such questions can be tV . 
by reviewing related experience gained under *. 
lier programs. A considerable volume of mo«' - 
cation activity occurs regularly and can pm- 
insight into the feasibility of PM and some guid 
on how best to pursue this strategy. In doing - 
analysis of PM for the Air Force, the Rand C ' 
poration studied modification programs simile : 
preplanned product improvement and aNo f •- 
viewed ad hoc modification efforts. Such u sur 1 *' 
of past efforts raises serious concerns. 

Aircraft development contracts, both comm-- r 
cial and military, often include growth or mod • 
cation potential as a design goal. Aircraft designc 
and manufacturers have every incentive to 
the most'flexible, easily improvable system p» 
sible because future modification potential m^ rB 
longer production runs and greater eventual sal-* 
The Defense Department too has recognized 
value of improvement potential. In the early I^ iW 
for example, the request for propusal for the 
vanced medium short-takeoff-and-landing tra^** 




or technological advances with enough specificity to preplan 
improvements far into the future is unreasonable. Preplanning 
improvements to major systems is based on the premise that such 
anticipation is feasible; experience suggests it is not. 


port listed growth potential as a contract award 
evaluation factor. 

Surprisingly, however, a survey of all Air Force 
jet fighter modifications, most Navy fighter and 
attack aircraft programs, and several bomber mod¬ 
ifications reveals little evidence of any PM-like 
modifications. In fact, such a review indicates that 
rapid advances in technology, combined with 
changes in threat and user requirements, quickly 
erode any preplanned improvement potential. Only 
the F-5, the F-14, and the Northrop N-I02 proj¬ 
ects appear to have included elements of preplan¬ 
ning during the design stage. More recently, de¬ 
signs for the air-launched cruise missile program 
also contained plans to accommodate future im¬ 
provements. 

The Navy’s experience with the F-14 program 
illustrates how unforeseen difficulties can under¬ 
mine preplanned upgrades. In the 1960s, Navy 
planners were concerned that the proposed F-11IB 
would not adequately perform the fleet air supe¬ 
riority mission. The service believed it needed a 
fighter plarve quickly to replace the F-4 but knew 
that Congress was unlikely to fund the high-risk 
crash effort a new fighter development program 
would probably entail. So Navy designers com¬ 
bined F-111B subsystems then being developed, 
the TF-30 engine, and the AWG-9 Phoenix mis¬ 
sile system into a new airframe. Combining these 
systems reduced the technical risks and provided 
the needed capability more rapidly than if design¬ 
ers had developed a wholly new system from scratch. 

However, the Navy still saw a need for better 
subsystems and planned to gradually upgrade the 
F-14. The first aircraft produced was to be the F- 
14 with the TF-30 engine and the AWG-9 missile; 
later F-14Bs would use the more powerful F401 
engine, which was in the early stages of dcvelop- 


troduction of the F-14C, with improved avionics. 

Unfortunately, developing the F-14A proved a 
more difficult task than expected. Because of cost 
growth, delays, and technical difficulties on the 
airframe, the TF-30 engine, and the F401 engine, 
the Defense Department postponed the purchase 
of the F-14B indefinitely. The Navy has tried un¬ 
successfully to reverse this decision since 1971 and 
therefore has not been able to realize the hoped- 
for benefits from anticipating future improve¬ 
ments. Some contend that the F-14A remains 
somewhat underpowered as a result. 

While the F-14A illustrates the vicissitudes that 
can befall a weapons program, the development 
problems encountered in the F-I4A program can¬ 
not be attributed to pursuing a development strat¬ 
egy similar to PM. In fact, by choosing the TF-30 
engine, a more technically mature engine than the 
F401, the Navy may have avoided additional prob¬ 
lems. The decision to reduce cost, schedule, and 
technical risks by using the TF-30 engine, how¬ 
ever, forced the Navy to settle permanently for an 
engine that planners envisioned as a transient one. 

The dearth of PM-like experience made it ad¬ 
visable to examine aircraft systems which have suc¬ 
cessfully undergone many ad hoc modifications to 
determine why they were so adaptable to being 
upgraded. Three such programs in the active Atr 
Force and Navy aircraft inventories are the B-52, 
the F-4, and the Navy A-4 attack aircraft. How¬ 
ever, the designers of those systems would prob¬ 
ably not have been able to guess accurately the 
nature and variety of the future alterations made 
to their original designs; for instance; 

• How could Boeing designers in the late 1940s 
foresee that changes in Soviet air defenses would 
require modifying the B-52 in the late 1960s to 
operate at low altitudes? 


meet the Navy’s requirement for a fleet air defense 
aircraft in the 1950s, anticipate its air-to-ground 
role in the mid-1960s? 

• When they built the A-4 in 1953, E. H. Hei- 
nemann and the Douglas Company set out to pro¬ 
duce the lightest, simplest aircraft possible. They 
made no special provisions for incorporating new 
engines, larger ordnance loads, or improved avion¬ 
ics, yet the firm has since produced nearly twenty 
versions of the aircraft. 

The reasons behind the long life of sysieins such 
as the A-4 seem to have more to do with luck and 
regularly applied good design practices than with 
carefully anticipating future improvements. In¬ 
deed, expecting designers to envision threat changes, 
mission changes, or technological advances with 
enough specificity to preplan improvements far into 
the future is unreasonable. Preplanning improve¬ 
ments to major systems is based on the premise 
that such anticipation is feasible; experience sug¬ 
gests it is not. 

Evidence from the F-14 program and the few 
others that utilized preplanning does indicate that 
forecasting improvements over only a few years, 
perhaps 3 to 5, may be workable, especially when 
the subsystems to be incorporated into the baseline 
system are already in development. This building- 
block approach may be especially appropriate for 
electronic systems, and in fact the Soviet MiG and 
the French Mirage aircraft programs have already 
successfully applied a development strategy which 
relies on off-the-shelf subsystems combined with 
incremental upgrades to improve capability. In¬ 
crementalism, as this approach is sometimes called, 
has never specifically entailed preplanning for up¬ 
grades. However, linking incremental develop¬ 
ment strategies with very short-term preplanning 
is probably more viable than the grander notions 
involving advanced long-term product improve¬ 
ments. 

Earlier programs also indicate that any preplan¬ 
ning involves risk. As in the case of the F-14, 
planned-for improvements may not be funded, and 
the service may have to settle permanently for what 
was initially thought to be a transitional system. 
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Figure 2. Modification efforts occasionally 
exhibit a greater percentage of cost 
growth than do new programs 
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An important premise of preplanned product 
improvement is that pursuing modest capability 
advances rather than new development programs 
can cut program costs and completion times. 
Moreover, that approach should reduce the risk 
of cost overrun and schedule slippage and thus 
translate into lower costs and shorter development 
times. 1 However, experience shows that caution is 
in order in accepting this premise as well. Although 
modification programs cost less than new pro¬ 
grams and are deployed earlier, they do not always 
decrease the risk of cost overruns and schedule 
slippage. As is clear from Figure 2, modification 
efforts have occasionally exhibited greater cost 
growth than new programs. 

Review of earlier modification programs sug¬ 
gests that those more successful in the areas of 
cost, schedule, and performance exhibited consid- 

1 Robert Perry, et ol. System Acquisition Strategies (Santa 




erably different management approaches than less 
successful programs. The former avoided highly 
concurrent development and production, allocated 
sufficient time and resources to proof testing, and 
provided a centralized management organization. 
In short, they avoided the classic pitfalls of weap¬ 
ons development programs. 

If preplanning involves risks of unrealized im¬ 
provements, faces traditional cost and schedule risks 
if poorly conducted, and is simply unworkable in 
its purest form, what strategies will address the 
procurement challenges of the 1980s? Although 

2 The data for these comparisons were developed from var¬ 
ious Selected Acquisition Reports. The performance, cost, and 
schedule goals reflect estimates made at the beginning of full- 
scale development; the achieved results are as of March 1978. 
Costs reflect total program cost adjusted to exclude inflation 
and quantity changes. Performance parameters were averaged 
for each program and were equally weighted. If the achieved 
performance results came within 10 percent, the goal hw con¬ 
sidered accomplished. For more detail on these calculations, 
see Edmund Dews, Giles K. Smith, etal., Acquisition Policy 
Effectiveness: Department of Defense Experience in the 1970s 
(Santa Monica, CA: Rand Corporation, October 1979), Re¬ 
port Number R-2516-DR&E. 


payons, nowever, ana aeserve more aiiennun: in¬ 
creasing the use of hardware competition in the 
acquisition process and reducing the time spent 
prior to issuing the hardware development con¬ 
tract in the system acquisition process. 

Comparison of four competitive programs—the 
A-10, P—16, UH-60, and AWACS—proved re¬ 
vealing. All four competitively developed pro¬ 
grams exceeded performance goals on average, 
while a group of noncompetitive programs—the 
K-15, Aegis, Harpoon, A1M-9L, CAPTOR, and 
M-I98—fell short of meeting all performance goals. 
The competitive programs also had less schedule 
slippage and considerably less cost growth than the 
noncompetitive group. 2 

Reducing fielding times is feasible, but cutting 
the growth of deployment time intervals has move 
to do with reducing the time prior to actual hard¬ 
ware development than with compressing the full- 
scale development phase of the acquisition proc¬ 
ess. The majority of the time interval growth in 
the past decades has been in the early stages of 
development; actual hardware development time— 
the period from full-scale development to first de¬ 
livery—has remained fairly stable (sec Figure 3). 
Indeed, hardware development time has remained 
about the same since the 1930s. 

Obtaining weapon systems that are effective, on- 
time, and within constrained budgets will no doubt 
continue to be a top priority in the Defense De¬ 
partment. Blit as the evidence reviewed above sug¬ 
gests, preplanned product improvement by itself 
is not likely to enable DoD planners and acqui¬ 
sition managers to meet those goals. They might 
better turn their attention to a mix of other strat¬ 
egies rather than emphasizing preplanned product 
improvement. 

FREDERICK F. BlERYis a member of the slaff 
of The Analytic Science Corporation. He previ¬ 
ously worked for the General Research Corpora¬ 
tion and the Rand Corporation. Mr. Biery holds a 
bachelor's degree from Ihe American University and 
a master's degree in business administration from 
the Wharton School, University of Pennsylvania. 




what are the incentives 
in incentive contracts? 

By DAN C. BOGER, 

CARL R. JONES, 
and 

KEVIN C. SONTHEIMER 

Cost- and profit-sharing arrangements in procurement contracts 
can actually create an incentive for government and industry management 
to allow costs which result in subsequent cost growth. 


r.i 


I nterest in making major changes in the defense pro¬ 
curement process is steadily burgeoning. Changes to 
date have ranged from the introduction of multiyear 
contracting to a renewed emphasis on competition among 
contractors. Such changes arc deemed essential largely 
because the Department of Defense continues to ex¬ 
perience significant problems in controlling the cost, 
schedule, and performance outcomes of its procure¬ 
ment contracts. 

These problems can hardly be considered surprising 
or new. In the early 1960s, DoD reduced its reliance 
on fixed-price contracts and increased its use of incen¬ 
tive contracts because the then-prevailing contract forms 
and practices were not perceived to be providing con¬ 
tractors with sufficient reason to control their costs. 
Later modifications of the process, such as total-pack¬ 
age procurement, represented further efforts to eradi¬ 
cate the same vexing problem. 

Concurrent with these changes in institutional prac¬ 
tices was an increase in the number of analytical studies 
on the pluses and minuses of various contract types. 
While the research community originally addressed the 
more general problem, it has since gradually focused 
its attention more narrowly on those problems posed 
by risk and the consequent issue of optimal risk-sharing. 
This body of literature has led to a greater understand¬ 
ing of the role of risk and uncertainty in contractual ar¬ 
rangements. hn it hns nkn neolerted other ermnllv im- 


Thc approach suggested in this article treats as pri¬ 
mary determinants of contract performance (wo such 
aspects of the contractual arrangement. The first and 
more fundamental aspect is that production contracts 
for major weapon systems (wherein most cost growth 
has been experienced) are usually not one-period, one¬ 
time arrangements, but rather are ongoing relationships 
with contractors who have a long history of performing 
government work. The corollary aspect is that there 
exist links between these ongoing relationships and the 
federal budgeting process, that is, budget appropria¬ 
tions are conditioned by budget requests, which in turn 
are conditioned by prior contract experience. 1 

Recognition of these two aspects of the contractual 
relationship underlies the alleged buy-in phenomenon. 
To claim that contractors buy in is to claim that they 
have a time horizon in making a decision on a proposed 
contract which encompasses more than a single con¬ 
tract. Furthermore, the buy-in claim implicitly recog¬ 
nizes differences among proposed costs, actual costs, 
and minimum or competitive costs for a given contract. 
It also recognizes the process by which the allegedly 
excessive proposed costs are validated within the overall 
acquisition process. 

This article reports the results of the integration of 
the two aspects into a model of the government-supplier 

1 For a qualitative evaluation of one of the links in this proc- 
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contractual setting. 2 The current model, which extends 
previous work, includes the effects of both varying lot 
sizes during the production cycle and the learning curve 
phenomenon occurring during the production process. 3 
The results indicate that current institutional arrange¬ 
ments such as cost- and profit-sharing create an incen¬ 
tive for government and industry management jointly 
to allow costs which result in subsequent cost growth. 

Basic assumptions 

In modeling the government-supplier relationship, 
there are three major elements: the supplier or con¬ 
tractor and that party’s behavior, the government and 
its behavior, and the contract which codifies the rela¬ 
tionship between the two. 

The contractor's business objective is to maximize 
profit over several time periods into the future. This 
implies that the contractor evaluates alternatives based 
on the discounted present value of the long-run profit 
streams that result from a particular decision. Although 
there has been criticism of this decision criterion, recent 
research indicates that several other criteria are in fact 
equivalent to long-run profit maximization. 4 

To facilitate the exposition, let us assume that the 
contractor is producing a single product. Because the 
contractor can be expected to learn a great deal in the 


2 A version of /his paper which includes an analytical model 
is available from the authors. 

* A selection of references from this literature is contained 
in Dan C. Boger, Carl R. Jones and Kevin C. Somheimer, 
“An Analysis of the Incentives Present in Incentive Contracts, ” 
in Proceedings of the 1982 Federal Acquisition Research Sym¬ 
posium, U.S. Army Procurement Research Office, Ft. Lee, 
VA, May 1982. 

4 See H. E. Leland, "Alternative Long-Run Goals and (he 
Theory of the Firm: Why Profit Maximization May Be a Better 
Assumption Than You Think,” in P. T. Liu, Dynamic Op¬ 
timization and Mathematical Economics (New York: Plenum 
Press, 1980). 


doing can be treated as the labor efficiency effect. 

The model treais the government as an amalgam of 
various bodies, agencies, and departments. Since no 
objective function is attributed to it, only its procedures 
and behavior are considered. Moreover, once decisions 
have been made, the procedures and behavior are con¬ 
sidered public knowledge. This is particularly important 
in deriving the linkages discussed below. 

In analyzing the government’s behavior, one must 
understand the manner in which it budgets purchases. 
Funds are appropriated for a desired quantity of a par¬ 
ticular product each year. While quantity of items and 
the money appropriated to buy them may vary from 
year to year, each is determined and fixed for a partic¬ 
ular year. 

The annual budget appropriation for a particular item 
is determined through calculations involving both the 
desired quantity of that item for that year and the item’s 
historical unit costs. To facilitate the discussion, we 
have assumed that the purchase quantity is determined 
by such decisions as those made in the development of 
the Five Year Defense Plan. Historical unit costs are 






Figure 1. An exantev'x&N 
of the contracting and budgeting process 
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this situation is the production phase of a major 
capon system.) The chosen contractor can look for* 
ard to a sequence of yearly contracts that can extend 
r five-to-seven years or longer. 

The contraci itself, which is assumed to be of the 
rneral incentive type, will provide for revenues to be 
tid to the firm upon delivery of the required quantity 
the product. These revenues are determined by ae* 
al production costs, the proposed costs of production, 
id several incentive features. The primary incentive 
atures are those of the cost-sharing ratio and the in- 
ntive fee ratio. The cost-sharing ratio determines how 
e contractor and the government share cost overruns 
underruns; the incentive fee ratio determines the 
nount of the contract specifically set aside for profits 
the contractor. 

nique model characteristics 

It is hypothesized that there exists some minimum 


Figure 2. An ex post view 
of the contracting and budgeting process 
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Due to various factors such as the bureaucratic en¬ 
vironment or managerial slack, however, observed costs 
have usually risen above this competitive level. The 
difference between competitive and observed costs is 
called convenience costs, which arc a result of both the 
contractor and the government not having to enforce 
strict cost control. In fact, the relationship between the 
contractor and the government is typically not of the 
classic arms-lengih variety, but is more of a bilateral 
monopoly. It follows that government behavior can 
strongly influence the occurrence of convenience costs. 

What causes convenience costs? One possible answer 
is that defense and industry managers often emphasize 
the technical and scientific aspects of a product to the 
apparent exclusion of the cost aspects. When this oc¬ 
curs, cost implications of alternative solutions to tech¬ 
nical problems tend to be neglected. Pressures for these 
purely scientific or technical solutions exist on both sides 
of the contract relationship. 

In addition to convenience costs, the linkages hy¬ 
pothesized are also important. The contractor views the 
sequence of contracts as being linked, since a decision 
to enter the first contract is a decision to enter all of 
the subsequent contracts. Additionally, a link is pos¬ 
tulated between the budgeting process and the con¬ 
tractual relationship. This link is the proportion of re¬ 
quested funds which accrue to the contractor as a result 
of the initial contract negotiations. 

This proportion, termed the budget parameter, must 
be examined prior to and subsequent to the budgeting 
process. The ex post value of the parameter depends 
upon how strongly the government wants or needs the 
product; this involves a combination of agency desires, 
presidential and congressional interest, and the political 
climate in which the defense budget was derived. How¬ 
ever, the ex ante value of the budget parameter must 
be approximately unity. 

Viable contracting requires an implicit understanding 
between parties that allowable, recurring costs will be 
covered in subsequent contracts. Thus, the budget pa¬ 
rameter, both ex ante and ex post , represents the trans¬ 
formation of current cost experience into subsequent 
contract appropriations. 

Model predictions 

In a single period, an increase in convenience costs 
results in a decrease in the contractor’s profits. How- 
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ever, in a multiple period environment, higher costs in 
early periods form a basis for the costs of all subsequent 
contracts. Consequently, it is potentially advantageous 
to the contractor to absorb convenience costs at the 
beginningof the contract sequence and later recoup this 
investment. This potential net profit is a function of the 
contract cost-sharing ratio, the incentive fee ratio, the 
contractor’s internal discount rate, the labor efficiency 
effect, the quantity of products purchased in adjacent 
periods, and the proportion of the proposed budget 
accruing to the contractor. 

Of primary concern in this analysis are the parameters 
which are explicitly part of the contract: the cost-sharing 
ratio and the incentive fee ratio. By postulating rea¬ 
sonable values for the remaining parameters, one can 
determine what combinations of these two principal 
parameters will result in a positive incentive for con¬ 
tractors to incur convenience costs. 

A reasonable range for the firm's internal discount 
rate is 15 percent to 25 percent; for the cost-sharing 
ratio, 15 percent to 40 percent; and for the incentive 
fee, 8 percent to 15 percent. These are ranges which 
one would expect to encounter in practice. 

Ex ante. To examine the interrelationships of the 
model’s parameters, one may postulate alternative val¬ 
ues for several of the parameters and determine the 
resultant effects upon incentives for convenience costs. 
For instance, one may consider the contracting and 
budgeting process in an ex ante or planning mode. In 
this case the contractor seeks to determine the value of 
participating in a sequence of contracts by focusing on 
the ex ante value of the budget parameter, which is one. 
An initial value for the learning parameter will be taken 
as 0.90; this indicates that, if lot sizes were to double 
from one year to the next, total costs would rise by only 
90 percent, Finally, the firm’s internal discount rate, 
which is really an inflation-adjusted, before-tax rate, 
will be initially set at a median value of 20 percent. 

Reflertina these mrameters Ficmre I (n shows 
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the relationship of the cost-sharing ratio and the incen¬ 
tive fee ratio for three alternative cases: 

• Lot sizes constant over time. 

• Lot sizes increasing by 10 percent from period to 
period. 

• Lot sizes decreasing by 10 percent from period to 
period. 

The points on each line represent those combinations 
of the cost-sharing and incentive fee ratios for which 
there are no incentives attached to costs. All points to 
the right of each line correspond to those combinations 
which result in a net incentive for the contractor to incur 
convenience costs. All points to the left of each line 
correspond to those combinations where there is an 
incentive to seek the competitive cost level. Clearly, 
there are far fewer combinations to the left of each line 
than to the right. 

Moreover, an increase in the value of the learning 
parameter to a value closer to one (a case of no learning) 
will result in an increased incentive for the contractor 
to incur convenience costs. This is because a decrease 
in the amount of learning increases costs in all periods; 
thus, the contractor has a higher base of actual costs 
from which to invest his convenience costs. However, 
an increase iti the value of the contractor’s internal 
discount rate will result in a decreased incentive for the 
contractor to incur convenience costs. This is because 
the contractor is less willing to incur current costs which 
have a future return. 

Ex post. This entire process may also be viewed in 
in py nntt nr ren i'/ed htirlnet mode In this cas he 



contractor seeks to determine the value of undertaking 
t specific contract by analyzing the ex post value of the 
mdget parameter. Figure 2 (p. 19) shows alternative 
combinations of the cost-sharing and incentive fee ratios 
»ivcn that the budget parameter has an unusually low 
✓nine of 0.80 and the same internal discount rate and 
earning parameter as in Figure l. 5 Again, all combi- 
tations which occur to the right of the lines result in 
perverse incentives to the contractor. 

A comparison of Figures 1 and 2 shows that a de¬ 
crease in the budget parameter causes a reduction in 
he incentive to incur convenience costs. This is because 
l reduction in the budget parameter diminishes the Iink- 
lgc between prior costs and subsequent budgets, thereby 
Jccreasing the potential return to the contractor for 
ncurring convenience costs. 

A major conclusion of this analysis is that incentives 
change with varying lot sizes. As lot sizes increase, there 
s a relatively greater chance that a particular combi- 
tation of the cost-sharing and incentive fee ratios will 
■csult in incentives for incurring convenience costs. This 
effect is so strong that if all of the parameters arc set 
:o the most unfavorable points of their ranges, a year- 
:o*year increase of only slightly more than 60 percent 
.vill result in perverse incentives to the contractor. (These 

5 Alternative values of (he various parameters are explored 
f or the case of no learning and constant lot sizing in Boger, 
fones and Sontheimer, op. cit. Observed ranges of values for 
he cost incentive ratio, the incentive fee ratio, and (he firm’s 
V itcrnal discount rate indicated in (hat simpler model that the 
■’nine of 0.80 for (he budget parameter is unusually low. 


ccntive result. 

An illustrative example 

A detailed example will serve to clarify these general 
points and to illustrate several new ideas. Consider the 
following procurement pattern, where the numbers rep¬ 
resent the purchase quantities in seven consecutive pe¬ 
riods: 10, 15, 20, 25, 20, 15, and 10. Assume a com¬ 
petitive cost of $100 in the first period and a learning 
parameter of 0.90. (This information is sufficient to fully 
determine the competitive cost function for all seven 
periods.) Let the cost-sharing ratio be 0.20 and let the 
incentive fee ratio be 0.10; both of these arc values 
actually found in practice. Let the contractor’s proposed 
costs in the first period be $110, in which case the budget 
would be $121. Assume further that the upper limit on 
actual costs in any period is 12.5 percent above the 
proposed costs for that period and that there is a limit 
on cost incentive payments of 5 percent of proposed 
costs. Finally, assume that all costs arc incurred in al¬ 
lowable categories, that the budget parameter is 1.0, 
and that the contractor’s internal discount rate is 0.20. 

Using these values, one can demonstrate that there 
exist incentives for the contractor to invest in conven¬ 
ience costs in the first three periods and incentives to 
attain competitive costs in the last four periods. The 
presence of these proper cost incentives in the last four 
periods is due solely to the declining lot sizes in these 
periods. The effects of these values on actual cost per¬ 
formance and the resulting profits can be illustrated 
witli two cases: that of the cost-minimizing contractor 
and that of the profit-maximizing contractor. 

Figure 3, which contrasts the discounted cost per¬ 
formance of the two cases, shows that the cost incentives 
are such that the profit-maximizing firm allows full ex¬ 
pansion of the convenience costs in the first three pe¬ 
riods. In period four, the profit maximizer begins to 
reduce its convenience costs and, solely in the interest 
of profits, starts the transition toward competitive costs. 
Notably, the profit maximizer does not move imme¬ 
diately to the competitive cost level because of the limit 
on cost incentive payments that can be made to the 
contractor in any one period. For the last three periods, 
the costs of the profit maximizer are indistinguishable 
from those of the cost minimi/.er. 

In the fourth period of Figure 4, which profiles the 
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discounted profits of the two cases, the profit maximizer 
recoups the convenience costs built up in the first three 
periods. But because the limit on cost incentive pay¬ 
ments is effective in the fourth period, some conven¬ 
ience costs remain for the profit maximizer in the fifth 
period. The remainingcost incentive payments received 
in the fifth period cause that period’s profits to be larger 
for the profit maximizer than those for the cost mini- 
mizer even though competitive cost levels are realized 
for both in that period. The profits of the two cases are 
identical in the last two periods. 

This example illustrates the potential for misinter¬ 
pretation of profit-maximizing behavior. The actual costs 
incurred in the first three periods correspond to cost 
overruns. In the fourth period, the firm experiences a 
significant improvement in cost performance and achieves 
a significant cost underrun. A smaller cost underrun is 
experienced in period live and costs are on target in 
the last two periods. The improved cost performance 
in the latter periods could readily be misinterpreted as 
the beneficial results of exhortation, threats, and pres¬ 
sure exerted by DoD, the President, and the Congress 
during the cost overruns of the early periods. However, 
this improvement is only a response to the incentives 
presented by this particular combination of parame¬ 
ters—that is, as the contract circumstances warrant. 

This example also illustrates that profits are actually 
higher in the first two periods for the cost minimizer 
than for the profit maximizer. This is because the profit 
maximizer is then engaged in investing in convenience 
costs which will be recouped. However, a single-minded 
concentration on profit levels alone could lead one to 
conclude erroneously that the cost minimizer is com¬ 
paratively inefficient since the profit maximizer is earn¬ 
ing a lower level of profits. It is even possible that 
exhortations to accept “low” profits could cause a con¬ 
tractor to transition from cost-minimizing behavior to 
profit-maximizing behavior. This points out the impor¬ 
tance of viewing the contractual arrangement in its to- 


combinations of the cost-sharing ratio and the incentive 
fee ratio can create incentives for cost growth despite 
the presence of cost-control incentives in a contract. 
The model also illustrates the sensitivity of cost incen¬ 
tives to changing lot sizes during production. In addi¬ 
tion, incentives for cost growth can occur at easily ob¬ 
servable values for the cost-sharing ratio, the incentive 
fee ratio, year-to-year changes in lot sizes, the con¬ 
tractor’s internal discount rate, the labor efficiency fac¬ 
tor, and the budget parameter. 

Most importantly, this model indicates that at cur¬ 
rently utilized values for the incentive fee ratio, the cost¬ 
sharing should be increased greatly to avoid incentives 
for the contractor to incur convenience costs. Although 
similar recommendations can be found elsewhere in 
incentive contracting literature, the present model is 
unique in that it offers a quantitative evaluation of the 
amount by which the cost-sharing ratio should be in¬ 
creased. DJVJJ 
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Property rights 
and the cost growth 
of weapon systems 

By HAROLD J. BRUMM JR. 

DoD policymakers seeking to curb 
weapon system cost growth should 
take into account factors motivating 
the economic behavior of personnel 
who manage those systems. 


We need elucidation of the obvious more than 
we need investigation of the obscure. 

—Oliver Wendell Holmes 

A widely known and disturbing fact is that the 
current generation of weapon systems is or¬ 
ders of magnitude more expensive than previous 
generations.* Moreover, this phenomenon is part 
of a continuing trend: over the last two decades 
the cost growth of military equipment and weapon 
systems, in real terms, has risen at an average an¬ 
nual rate of 6 percent.' 

Various reasons have been offered for these es¬ 
calating costs (see figure, p. 24). 2 There being 
nothing particularly mysterious about these pos- 

* The views expressed in this paper are strictly those of the 
author and do not necessarily represent any official position 
of the U.S. General Accounting Office. 

1 Leonard Sullivan Jr., "Correlating National Security and 
Defense Investment," in From Weakness to Strength, ed. W. 
Scott Thompson (San Francisco: Institute for Contemporary 
Studies, 1980), p. 343. 

7 Robert Foelber, "Cutting the High Cost of Weapons," 
Backgrounder, No. 172, Heritage Foundation (March 16, 1982), 





Conventional explanations 
of weapon system cost growth 


Design 

• Quest for qualitative supefio/ity 

• Lack ot interservice standardization 

• Failure to use off-the-shelf parts 


Budget and management 

• Budget instability 

• Low production rates 

• Cos! and inflation misestimates 

• Lack of competition 


Defense Industry 

* Subcontractor bottlenecks 

* low productivity 

* Labor instability and shortages 


stble sources of cost growth, proposals to mitigate 
their effects cottld be anticipated and indeed have 
been advanced over the years. Some of the latest 
arc among the 32 initiatives issued by former Dep¬ 
uty Secretary of Defense Frank C, Carlucci in April 
1981, which comprise the Acquisition Improve¬ 
ment Program of the Department of Defense. 
However, despite all such proposals and efforts to 
implement them, currently and in the past, the cost 
growth problem persists. 

This conundrum has stimulated at least one writer 
to look tn new directions for solutions. In his widely 
acclaimed book National Defense, James Fallows 
asserts that “the driving force behind these cost 
increases has been the pursuit of technical com¬ 
plexity.” Fallows suspects that “the real reason 
. . . high technology is king has to do with the 
culture of procurement in the Pentagon.” This cul¬ 
ture, he further asserts, “draws the military toward 
new weapons because of their great cost, not in 
spite of it.” 3 Although interesting, these assertions 
beg a question that Fallows never quite answers; 
what are the causal relationships between the eco¬ 
nomic incentives of DoD decisionmakers and the 


would, presumably, provide important insights into, 
if not outright solutions to. the problem of w eapon 
system cost growth. 

The present article argues that many of the 
“causes” conventionally attributed tu the cost 
growth phenomenon arc largely symptoms of the 
real problem, the property rights structure that 
exists in DoD. If this view is correct, the focus of 
efforts to curb weapon system cost growth should 
be expanded, tf not redirected. The task would he 
to devise mechanisms that will make the self-in¬ 
terest of DoD decisionmakers, both military and 
civilian, more nearly coincident with the objective 
of minimizing the cost of maintaining an adequate 
national defense. Adequacy in this context is de¬ 
termined by the President and Congress. 

In this article the term “property rights” refers 
to one’s effective claims to rewards (positive or 
negative) as a result of one’s actions. J Within any 
organization, property rights are sanctioned be¬ 
havioral relations among the members of the or¬ 
ganization; these rights derive from the scarce re¬ 
sources over which the organization has control. 
As such, the property rights system can be de¬ 
scribed as the set of economic and social relations 
that define the position of each member of an or¬ 
ganization with respect to utilization of the re¬ 
sources available. The prevailing property rights 
structure within an organization, along with the 
individual’s acquired and inherited human capital 
(intelligence, experience, and so forth), deter¬ 
mines the set of opportunities—hence the trade¬ 
offs—confronting him or her. 5 

One hypothesis of this article is that individuals 
functioning within DoD have the same general mo¬ 
tivations as other people; all respond to incentives. 
Thus if the perceived costs and benefits associated 
with any action change markedly, an individual’s 
choices will also change. This view departs from 
that which ascribes a unique motivation to the DoD 
decisionmaker (for example, Fallows’ nd hominem 
dichotormzation of the professional officer corps 
into two groups: those with the culture of arms in 

* Roland N. McKean, "Property Rights Within Government 
. . a /■».. ->• c , .,i 


amDiuous w j. i nc promeni witn sucn an assumption 
about human behavior is that it renders impossible 
any substantive predictions about the outcomes of 
objective circumstances, such as procurements of 
alternative weapon systems. One would have to 
make a psychological examination of any individ¬ 
ual DoD decisionmaker before it would be pos¬ 
sible to predict that person’s behavior. 

Given the assumption that DoD decisionmak¬ 
ers’ choices, like those of all other individuals, arc 
the outcome of egocentric cost-benefit analyses, 
tinderstanding their behavior requires a knowledge 
of DoD’s property rights structure and the oppor¬ 
tunities Defense decisionmakers have for appro¬ 
priating rewards. Significantly, to the extent that 
such appropriability is attenuated, inefficiencies will 
crop up in weapon system programs. 7 

The well-publicized case of the cost growth of 
the C-5A transport aircraft, albeit an extreme in¬ 
stance, illustrates this point. Even though several 
Pentagon officials evidently knew about this prob¬ 
lem since at least November 1967, official admis¬ 
sion of its existence was not forthcoming until Er¬ 
nest Fitzgerald testified before a subcommittee of 
the Joint Economic Committee of Congress in No¬ 
vember 1968. K This hick of candor can be attrib¬ 
uted to the DoD bureaucrat’s perception that, 
whatever benefits might accrue to society from di¬ 
vulging the C-5A cost overruns, lie or she had little 
to gain personally from releasing the information. 
In fact, the DoD property rights structure had cer¬ 
tain inherent disincentives to cost conlainmem ef¬ 
forts. If these were not obvious already, they be¬ 
came readily apparent to other DoD personnel 
when Mr. Fitzgerald was fired in November 1969. 

It is important to recognize that the inefficiency 
implicit in attenuated appropriability is not based 
on a misperception that isolated individuals, each 
with a different set of motives, make decisions (at 
least official ones) in DoD. Even if all DoD de¬ 
cisionmakers were motivated by the exact same 
objectives, it is unlikely that all would assign the 
same relative subjective values to different goals 
or to the different means available for attaining 

* Fallows, p. l!4. 

7 McKean, p. 180. 
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mey prcierreci or rcgaraeci as more important. 
Group decisions are actually the outcome of de¬ 
cisions made by individuals whose self-interests vary, 
as do the values they assign to organizational goals 
and their perceptions of the best means to achieve 
those goals. 

A DoD decisionmaker, by definition, is a person 
who has the authority to exercise some discretion 
over the allocation of at least a portion of DoD’s 
resources. The amount of discretion an individual 
possesses is one determinant of his or her set of 
opportunities. The weaker the correlation between 
the well-being of the individual (as he or she secs 
it) and the well-being of higher-level decisionmak¬ 
ers (as they sec it), the more likely the individual 
is to increase the former at the expense of the 
latter. Higher-level decisionmakers realize this and 
therefore impose special constraints on the indi¬ 
vidual’s choices—an unscheduled inspection of an 
aircraft squadron, lor example, in order to check 
the validity of the commanding officer’s opera¬ 
tional readiness report. However, since detecting 
and policing infractions arc not costless (time and 
effort are not free goods), each decisionmaker has 
opportunities to divert resources to the service of 
his or her own self-interest, possibly sacrificing some 
of the well-being of hierarchical superiors in the 
process. 10 

The hypothesis of self-interest maximization im¬ 
plies that an individual decisionmaker will try to 
expand the resources under his or her control be¬ 
yond the quantity that higher-level decisionmakers 
deem optimal. By doing so, the decisionmaker in¬ 
creases his or her apparent contribution to the or¬ 
ganization’s output, thereby enhancing the likeli¬ 
hood that he or she will receive promotions and 
salary increases. And since individual performance 
in DoD cannot be evaluated by objective measures 
of productivity such as contribution to profitabil¬ 
ity, decisionmakers arc in fact induced to offer 
other evidence of their worth to the organization 
in the form of visible tokens of accomplishment. 11 

This inducement may lead to outcomes which, 

■' Louis De A lessi, ' 'Implications of Property Rights for Gov¬ 
ernment Investment Choices ," American Economic Review, 
March l% l J, pp. 13-24. 

a /i„ i >. ..... ... x ; 7 


bie lor the acquisition of a particular weapon sys¬ 
tem has greater incentive to allow the contractor 
to ptit unnecessary “bells” and “whistles” on pro¬ 
duction tinits than would be the case in a com¬ 
petitive environment. 

The property rights theory provides a plausible 
explanation for behavior which Fallows alleges to 
be characteristic of DoD decisionmakers. In a given 
procurement situation, he asserts, the more costly, 
move technologically complex weapon system usu¬ 
ally will be chosen over its less costly, less tech¬ 
nologically complex competitors. 12 As explained 
above, the property rights structure specifies norms 
of behavior with respect to resources that every 
member of an organization must either observe in 
his or her daily interactions with other members 
or otherwise bear the cost of nonobservance. That 
structure in DoD creates a real inccmive to max¬ 
imize the quantity of resources—people and dol¬ 
lars—under an individual’s control. (As is readily 
observed, the fast track of promotion in the federal 
bureaucracy is '‘manager” rather than, say, “an¬ 
alyst”—the former manages resources, the latter 
docs not.) Since the quantity of resources needed 
to acquire a more technologically complex system 
or subsystem almost always exceeds that for its 
less technologically complex counterpart, the for¬ 
mer usually costs more to acquire. 13 Thus the in¬ 
centive to maximize the quantity of resources man¬ 
aged leads to selection of the most costly, 
technologically complex piece of military hard¬ 
ware. 

The F-16 aircraft, according to Fallows, pro¬ 
vides an example of such “gold-plating.” 14 Origi¬ 
nally designed as a lightweight, low-cost fighter 
aircraft with a local battlefield air superiority mis¬ 
sion, the F-16 underwent some not-so-subtle 
changes shortly after going into full-scale engi¬ 
neering development. What went into that devel¬ 
opment phase as an austere, single-mission fighter 
aircraft came out as an expensive, multiple-mission 

12 Fallows , pp. 37-38. 

Franklin C. Spinney , "Defense Fads of LifeDepart- 
mem of Defense, December 5, 1980. 

M The level of command at which Fallows directs his criti¬ 
cism in this particular instance is higher than the program 
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turcs into the P-16 to accommodate future tectv 
nologica! enhancements, thereby transforming it 
into an even more expensive weapon system. IS 



Since greater technological complexity invaria¬ 
bly increases a weapon’s unit cost, some have at¬ 
tributed this additional cost to technological com¬ 
plexity per se, ignoring the incentives that induced 
the choice of the more technologically complex 
weapon system in the first place. 16 Yet such per¬ 
verse incentive effects are a direct consequence of 

|S Genera! Accounting Office, The F-16 Program: Progress, 
Concerns, and Uncertainties (Washington, DC: Government 
Printing Office, 1981). 

For example, see William D. White, U.S. Tactical Air 
Power (Washington, DC: Brookings Institution, 1974), pp. 
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ary s can ao pmiosopny uoes not casuy accom- 
.odate a program manager who reports that his 
r her weapon system “cannot do” or an officer 
ho reports that his or her command is not ready 
»perform its mission. 17 

The quest for visible tokens of accomplishment 
.kcs the form not only of procuring more tcch- 
ologically complex weapons but also of trying to 
;cclerate their introduction into the inventory, 
he Army’s M-l lank is an example. Although 
te tank continues to be plagued with propulsion 
roblcms, the Army intends to buy 720 units this 
:ar anyway and eventually modify those units to 
)rrecl existing defects. The service has opted for 
tis course rather than delay the procurement until 
te requisite engineering fixes have been deter- 
tined. lH 

The services’ up-or-om promotion system, cou- 
led with the small likelihood of an officer ever 
Uaining flag tank, exacerbates the sittiation. Early 
i their “first careers” as military officers, individ- 
als must begin planning lor their “second ca- 
:ers” in the civilian sector following retirement 
■om the armed services, which usually occurs in 
reir early forties—not the most propitious age at 
*hich to make a career change. Thus for the officer 
ssigned a tour of duty in procurement manage- 
tent, the prevailing property rights structure in 
)oD does not c/icourage taking a strong hand in 


11 Cf. Fallows , National Defense, p. 64; Thomas H. Etzold, 
>efcnsc or Delusion? (New York: Harper Row, 1982), p. 
13; and William V. Kennedy, "Honor Unbound," Washing- 
)n Post, December 30, 1982, p. A19. 

(J.S. General Accounting Office, barge Scale Production 
f the M-l Tank Should Be Delayed Until Its Power Train 
> Made Durable (Washington, DC: Government Printing Of- 
ce, 198!). 

,y 3. Ronald Fox, Arming America (Cambridge, MA: Har¬ 
are! University Press, 1974), p. 461. 

Martin Binkin and Irene Kyriakopoulos, Youth or L‘x- 
eriencc? (Washington, DC: Brookings Institution, 1979), p. 
7. 

Jl Fallows, p. 174. 

n Fallows, p. 175. 

2i Other suggestions, including some germane to (he supply 
ide of the military hardware arena, can be found in Fox, 
\rming America, pp. 449-478. Also see Dina Rasor, "Fight - 
ng with Failures," Reason, April 1982, pp. 19-28. 


realize tniu pusL-ieiueiiiein pusuiuus aic unoieu 
to officers who have demonstrated their appreci¬ 
ation for industry’s particular problems and com¬ 
mitments. ,,|g 

Considerations such as these argue for a sub¬ 
stantial overhaul of the current property rights 
structure in DoD. Some recommendations already 
proposed include: 

• Replacement of the up-or-om promotion sys¬ 
tem with one that encourages commitment to a 
term of military service that exceeds the 20 years 
now typically served. 2 " 

• Establishment of an agency, possibly outside 
of DoD and independent of the research and de¬ 
velopment bureaucracy that promotes new weap¬ 
ons, to test and certify new technologies as mis¬ 
sion-capable before they can be approved for 
procurement. 21 

• Introduction of interagency design competi¬ 
tion within a given military department to avoid 
letting one particular development center enjoy a 
bureaucratic monopoly on a weapon system. 22 

Of course, these proposals far from exhaust all 
possibilities for improvement. They merely suggest 
what might be done to alter the property rights 
structure confronting players on the demand side 
of the weapon system acquisition arena. 

In the preface to his 1936 classic The General 
Theory of Employment, Interest, and Money, J. 
M. Keynes wrote: “The ideas which arc here ex¬ 
pressed so laboriously are extremely simple and 
should be obvious.” 2 '' The general observations 
made in this article would seem obvious enough, 
too. Mowever, the record to date suggests that they 
have not been given enough attention. It further 
suggests that, unless reconfigured, the property 
rights structure in DoD will continue to generate 
perverse incentive effects that will thwart policy 
directives otherwise designed to limit weapon sys¬ 
tem cost growth. 


HAROLD J. BRUMM JR. is an economist with 
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A clear, simple guide 
to weapon system troubleshooting 

By BARRY S. COSSEL 
and 

STEPHEN H. WATERS 


As the services face a decline in the number of highly skilled personnel 
able to maintain sophisticated weapon systems, 
improved troubleshooting techniques can help reduce system downtime . 


Us 


S ophisticated weapon systems arc only effective 
when they are fully operational. Keeping sys¬ 
tem downtime to a minimum, therefore, is vital 
but increasingly difficult as weapons become more 
complex and competent maintenance technicians 
continue to be in short supply. In working on the 
U.S. Roland program, logistics engineers at Boeing 
were able to devise a troubleshooting method that 
addresses these problems. It is quick, relatively 
simple to use, and cost-effective when measured 
against comparable systems. This article describes 
that method, which is adaptable to other weapons 
systems as well. 

When a system fails to operate properly, main¬ 
tenance technicians usually troubleshoot the sys¬ 
tem to determine what is wrong, replace the faulty 
component, and then verify that the system op¬ 
erates properly. All too often, however, the proc¬ 
ess is not a smooth one. Frequently, the technician 
does not know where to begin troubleshooting or 
may not be able to understand the troubleshooting 
data. Sometimes he or she replaces the wrong com¬ 
ponent, uses complex, time-consuming test equip¬ 
ment and methods that arc not really needed, or 
simply spends excessive time troubleshooting. 
Underlying all these problems is poor trouble¬ 
shooting data; consequently, experienced, highly 


sonnel of this caliber are becoming increasingly 
scarce. 

Throughout the late 1970s, the average educa¬ 
tional level of recruits was below that of earlier 
draftees, while at the same time large numbers of 
experienced personnel were leaving the military. 
In addition, lower birthrates have caused a decline 
in the pool of young men available for military 
service; 1 as a result, the military may need to at¬ 
tract one of every three eligible men to meet the 
next decade’s manpower goals. 2 

The military has been trying to cope with this 
situation in part by improving and simplifying tech¬ 
nical data. A restructuring of data is needed if 
technicians with Jow skill levels or limited system 
knowledge arc to maintain complex systems with¬ 
out acquiring extensive analytical or system train¬ 
ing. The Army’s Technical Manual Writing Hand¬ 
book reflects this straightforward approach to 
developing troubleshooting data by dividing it into 
three basic areas: fault discovery, entry to trou¬ 
bleshooting data, and troubleshooting accomplish¬ 
ment. The guidelines emphasize that such data must 

1 Robert L. Goldich, “Military Manpower Policy and the 
AU-Volunteer Force,” Issue Brief 77032, The Library of Con¬ 
gress, Washington, DC, April 4, 1977 (updated July 7, 1980), 
pp. 4-6. 
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amid approach that starts at a general level and 
works down to details. Known as the modified 
half-split approach, this technique isolates a fault 
to half of the remaining system at a time until the 
final half is an individual, system-replaceable part. 
The writing guide also states that technical expe¬ 
rience, turn-around requirements, ease of testing, 
test time, component reliability, user environ¬ 
ment, and test equipment availability and require¬ 
ments must be considered in developing trouble¬ 
shooting data. 

A new approach 

Review of the U.S. Roland program to see if it 
complied with the Army’s technical manual indi¬ 
cated that the program’s troubleshooting data was 
incompatible with handbook requirements. To meet 
these requirements, Boeing developed a new ap¬ 
proach to troubleshooting which combines several 
existing methods and offers a number of advan¬ 
tages. 

The approach places all system troubleshooting 
data in one technical manual so that a technician 
docs not have to decide which manual to use. Since 
systems operators report most faults, a separate 
chapter of the manual treats each operator func¬ 
tion, Each chapter sequentially lists every visual 
or auditory event that occurs during successful 
completion of the function. If a fault develops, one 
of these events does not occur. Therefore, every 
visual or auditory event of every function is a sep¬ 
arate starting point for a technician to begin trou¬ 
bleshooting. The detailed procedures are set forth 
in a scries of yes-or-no questions which follow the 
pyramid approach referred to above and lead the 
technician either to replacing a specific component 
or to initiating automated testing. 

Although the format is important, troubleshoot¬ 
ing data are only as good as their supporting anal¬ 
yses. To create a disciplined methodology from 
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shooting data but are also a detailed record of the 
analysis performed. 

Typically, troubleshooting starts with an oper¬ 
ator who notes a fault and then reports that fault 
to maintenance. The maintenance technician re¬ 
fers to the troubleshooting guide and then repeats 
the operator function, noting the first visual or 
auditory event that does not occur. He or she next 
locates the specific troubleshooting procedures 
keyed to that event and answers the yes-or-no 
questions until the procedure directs the technician 
to replace a specific component or to conduct au¬ 
tomated testing. 

On the U.S. Roland program, the system sche¬ 
matics and wire list data closely support this trou¬ 
bleshooting approach. Restructuring of system 
schematics resulted in function-type schematics 
correlated with the functions in the troubleshoot¬ 
ing manual, and wire list data are organized by 
signal name as listed on the schematics. Also in¬ 
cluded in the wire list data are the primary func¬ 
tions using the signal and the signal level. These 
changes, together with the troubleshooting man¬ 
ual, provide the U.S. Roland program with a co¬ 
hesive set of technical data for troubleshooting and 
analyzing the operation of the system efficiently 
and effectively. 

Functional dependency charts 

The first step in preparing troubleshooting data 
is developing the functional dependency chart re¬ 
ferred to above. This document, adapted from the 
maintenance dependency chart, represents the in¬ 
terdependencies of all visual, auditory, and key 
testable events that occur when the system accom¬ 
plishes an operator-initiated function. 3 It also en¬ 
compasses all replaceable components which must 

3 Military Specification MIL-M-38799 (USAF), "Manuals, 
Technical: Schematic Block Diagrams (SBD) and Mainte¬ 
nance Dependency Charts (MDC),” August 15, 1971. 
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oi test points, replaceable components, lights, 
switches, and key items relevant to the function 
being analyzed. These entries are coded to identify 
initial states of switches, lights, test points, and 
other components; peculiar component data; and 
the location of component replacement proce¬ 
dures. 

The body of the chart contains dependency lines 
which represent the signal flow through the equip¬ 
ment necessary for the function to be completed. 
Each dependency line ends in an event which is 
coded to identify the type of event or the value to 
be measured at the test point. A dependency sym¬ 
bol indicates that the event on the line is dependent 
on the occurrence of a previous event. Yet another 
symbol tells the technician that a replaceable com¬ 
ponent must function properly for the event on 
that line to occur. Other codes arc used for switches, 
valves, and the like. 

Preparing this chart is time-consuming and re¬ 
quires overall system knowledge as well as a set 
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A principal benefit of this 
troubleshooting approach is 
that it allows technicians at all 
skill levels and with varying 
degrees of system knowledge 
to rapidly troubleshoot a 
complex system without 
extensive training. 


of integrated system schematics. In its finished form, 
the chart provides the analysis needed to prepare 
troubleshooting. Only when a complete roster of 
a system’s functional dependencies are shown on 
the chart can they he presented as an integral part 
of the troubleshooting data. As a troubleshooting 
guide with supporting procedures, the chart elim¬ 
inates the burdensome analysis that a maintenance 
person might normally have to perform. 

A 1 1U.. ...u *u_ c _»:_1 j _j__i__ • j» 


the writer to do a thorough, detailed analysis, btnee 
the writer’s depth of analysis is recorded on the 
chart, spot checks by a supervisor or the procuring 
activity will quickly detect an inadequate analysis. 
This feature solves a problem associated with tra¬ 
ditional troubleshooting by eliminating uncer¬ 
tainty over whether the troubleshooting represents 
a thorough analysis or a last-minute rush. 

Additionally, dependency chart analysis eases 
the task of incorporating changes in system design 
or maintenance concepts into the troubleshooting 
data. Finally, these charts have possible applica¬ 
tions in the areas of system training and failure 
mode and effects analysis. 

Troubleshooting guide 

Each guide provides the data needed to begin 
troubleshooting a specific operator function and 
consists of two parts, introductory data and the 
actual troubleshooting guide. The four basic parts 
of the introductory data are: 

• Initial function requirements. 

• Initial troubleshooting requirements. 

• Equipment requirements. 

• General safety precautions. 

Initial function requirements alert a technician 
to any conditions that must exist before a function 
can be performed. The initial troubleshooting re¬ 
quirements give information necessary to set up 
for troubleshooting, while the list of equipment 
requirements tells the technician what tools and 
materials are necessary to troubleshoot the func¬ 
tion. General safety precautions are those safe¬ 
guards required before or during the troubleshoot¬ 
ing. 

The troubleshooting guide is a tabular, chron¬ 
ological listing of all visual and auditory events 
shown on the dependency chart (see Figure 1, p. 
32). A page number refers the user to each detailed 
troubleshooting procedure. A maintenance tech¬ 
nician might use the troubleshooting guide as fol¬ 
lows. Before assuming that a fault exists, the tech¬ 
nician verifies that the initial function requirements 
were met. The technician then notes the initial 
troubleshooting requirements and general safety 
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then refer to troubleshooting procedure on page indicated. 


Order 

Ready to engage mode events 

Reference Page 


NOTE 



The following troubleshooting guide is for changing from the ready 
mode to engage mode. If failure occurred while changing from 
standby or surveillance, place fire unit m ready before trying to go to 
engage. When ready mode cannot be reached, refer to page 5-1. 


1. 

Did E light begin flashing after MODE switch was set to E?.. 

6-3 

2. 

Did optical sight door open?.. 

6-3 

3. 

Could turret lock be heard going up?. 

6-4 

4. 

Did INTRLK light on BITE control panel go out and 

6-5 

5. 

is E light on steady?.. 

6-5 
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repeats the function. The first time that an event 
listed in the troubleshooting guide does not occur, 
the technician refers to the page number listed 
across from that event for detailed troubleshooting 
procedures. 

Troubleshooting procedures 

The troubleshooting procedures are developed 
by assuming that each event on the functional de¬ 
pendency chart is the first event that does not oc¬ 
cur. Knowing which events occurred correctly en¬ 
ables one to determine easily the associated 
component and circuitry that are functioning and, 
therefore, are not faulty. The structure of the func¬ 
tional dependency chart facilitates this task. By 
simply looking at the chart, one can quickly locate 
most of the cheeks or testing needed to isolate 
possible faults- The procedures reflect the basic 
assumptions that only a single fault exists and that 
all events listed in the troubleshooting guide prior 
to the event in question occurred correctly. 

A technician begins actual troubleshooting by 
answering a series of yes-or-no questions (see Fig¬ 
ure 2). If an answer is positive, the technician does 
the next step at the same indenture level. If an 
answer is negative, he or she proceeds to the first 
subindentured step. This procedure continues until 
the troubleshooting either directs the technician to 
re lace a faulty component or references specific 


automated testing. The lowest echelon of main¬ 
tenance personnel do all steps unless a step is coded 
for higher-level maintenance personnel. 

These procedures enable an unskilled technician 
to diagnose a system failure as though he were 
highly skilled in using the complete system anal¬ 
yses found in dependency charts. Technicians need 
not have extensive system knowledge nor do they 
need dependency charts to locate system faults. 

Since personnel at all skill levels will use these 
procedures, they provide detailed information on 
performing standard troubleshooting tasks and on 
locating equipment and test points. To avoid mak¬ 
ing the procedures confusing and cumbersome, most 
of this data is placed in a separate chapter, so that 
highly skilled personnel can use the procedures 
with a minimum of detail. 

Advantages 

A principal benefit of this troubleshooting ap¬ 
proach is that it allows technicians at all skill levels 
and with varying degrees of system knowledge to 
rapidly troubleshoot a complex system without ex¬ 
tensive training. Several other features make it a 
superior approach as well: 

• Troubleshooting is based on a logical analysis 
of normal system operation rather than on a shop¬ 
ping list of possible faults. 

• It makes maximum use of available system 











6. E LIGHT IS NOT ON STEADY 


a. Is SYS NG light on? If not: 

Replace cabin signal junction box (UW>. 

b. Remove access panel trom logic unit and set system failure 
override switch S4 to TR. Ooos E light continue to Hash? 

If not: 

til Is 16 vdc present between LWJ9 pins 34 end 116? If not: 


methods earned out to a comparable level of de¬ 
tail, the costs are approximately the same and the 
approach requires significantly fewer pages. 

These advantages suggest that serious consid¬ 
eration should be given to using this troubleshoot¬ 
ing approach both for newly procured systems and 
for existing systems on which efficient trouble¬ 
shooting has been a problem. 


Adjust optical sight door open switch (TL2) 

ITM 9-1425-625-20-2.) If switch cannot be adjusted, 
replace switch (TL2) ITM 9 1025 625-20-2} 

121 Replace logic unit (LW) J120 card ITM 9-1425 626 20-21. 

c. Sat switch S4 to center position. 

d. Is 15 vdc present between LWJ9 pins 46 and 116? If not: 

ID Is 28 vdc presont between LWJ10 pins 104 ond 83? II not: 

fa} Is 15 vdc p/esem between LWJI) pins 38 and 60? 

If not: 

J. Is !5 vdc prosent between LWJ11 pins 64 and 50? 
if not: 

Replace logic unit (LW) Jl20card 
(TM9-1425-625-20-2). 

2_ Replace logic unit (LW) JI21 card 
ITM 9-1425 626 20 21. 


tbl Replace logic unit (LW) J122 card 
ITM 9-1425 625 20 2). 

t2)Replace command computor (DR) ITM 9-1426-625-20-2). 
" e. Is 16 vdc present betwoon LWJ9 pins 95 and 116? If not: 


DS/GS 


Replace turret locked limit switch fSG7) 
(TM 9-1425-Q26-34-1). 


s ; I. Is 15 vdc present between LWJ9 plus 30 and 116 and 
between pins 31 and 116? If not: 

Replace logic unit (LW) J120 cord ITM 9-1426-626-20-2L 

. ; g. Replace cabin signal junction box (VWI J104 card. 
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indicators and information concerning what docs 
and does not operate properly. 

• Use of complex test equipment is limited to 
only those situations in which it is really required. 

• A disciplined analysis of system operation is 
performed, documented, and the results incor¬ 
porated in the troubleshooting data. 

• The approach has a single, clearly defined 
starting place and is integrated, not fragmented by 
subs stems. 


Outlook 

Boeing began developing this approach to trou¬ 
bleshooting in June 1979 in response to problems 
that the Army was facing with available trouble¬ 
shooting data. The demonstration conducted for 
the Army and contractor personnel in December 
1979 showed that quick, accurate troubleshooting 
is possible under this approach, even when using 
simulated faults that technicians were not familiar 
with. The Army authorized full development of 
the approach for use with the tJ.S. Roland pro¬ 
gram and has also released a draft technical man¬ 
ual. In early 1983, Army personnel will formally 
validate the troubleshooting data by locating un¬ 
known simulated faults and any real faults that 
might occur. DjVfJ 
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Performance-based monetary rewards 
can boost individual productivity 

By £ CHANDLER SHUMATE, 

STEVEN L DOCKSTADER, 
and 

DELBERT M. NEBEKER 

The Navy’s experiments with a performance-contingent reward system 
at selected shipyards have shown remarkable potential 
for motivating the work force to achieve greater productivity. 


T he term “productivity improvement” is rapidly be¬ 
coming ensconced in the lexicon of management as 
the single most desirable goal that a manager can achieve. 
Unfortunately, it can also prove to be one of the most 
elusive. 

Productivity—the ratio of work output to resource 
input—can be enhanced through advances in technol¬ 
ogy, methods improvement, and increased employee 
motivation. Yet while advances in technology and 
methods improvement hold tremendous potential for 
producing a given product at less cost, maximum effi¬ 
ciency cannot be achieved without a highly motivated 
work force. 

With this in mind, the Navy Personnel Research and 
Development Center began a series of studies in 1975 
directed toward developing and implementing moti¬ 
vational techniques designed to increase worker pro¬ 
ductivity in applied settings. One such technique, a per¬ 
formance-contingent reward system, has led to long¬ 
term improvements in the productivity of key entry 
operators at the Long Beach Naval Shipyard and the 
Mare Island Naval Shipyard. This article describes the 
studies carried out at these two activities and the results 
that were achieved. 1 

A performance-contingent reward system is a man¬ 
agement method that awards a monetary bonus to an 

' From S. L. Dockstader, D. M. Nebeker, J. Nocelfa, and 
E. C. Shumate, Incentive Management Training: Use of Be- 


individual or group for performance that exceeds stand¬ 
ards. A basic assumption underlying the implementa¬ 
tion of such a system is that employees arc not per¬ 
forming at their full potential. The proposition is not 
that people are basically lazy and don't care about their 
work. Rather, the premise holds that many people sim¬ 
ply do not know what their full potential is and that 
most work environments provide neither the direction 
nor the incentive required to develop that potential. 

Given these assumptions, managers and supervisors 
must decide how to maximize tlte performance potential 
of their employees. One way is to adopt a philosophy 
that people will voluntarily improve their performance, 
sometimes dramatically, if only they perceive that (he 
improvement will be followed by positive conse¬ 
quences, such as meaningful and systematic recogni¬ 
tion, and not by negative consequences, such as higher 
job standards or jeopardized job security. 

Critical questions 

In designing a monetary reward system to improve 
productivity, three questions demand consideration: Who 
should receive a reward? How much money should be 
awarded? And how often should a reward be given? 

Who should receive a reward? Typically, an organi¬ 
zation rewards its best performer or a very small group 
of employees. The problem with such a system, how- 
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ihe proper amount to reward an individual or group 
should be based, in part, upon the value of (heir per¬ 
formance to (he organization. Using a “sharing rale” 
concept, a manager could base the amount of a reward 
on some percentage of actual savings to the organiza¬ 
tion. Although this approach is used in administering 
the Federal Beneficial Suggestions Program, it has not 
been systematically applied to performance awards until 
quite recently. 2 

If a reward is to motivate, an employee must believe 
that the size of the reward merits increased personal 
performance. Currently, exact methods for determining 
optimal award levels have not been determined. How¬ 
ever, one prominent industrial engineer has recom¬ 
mended a minimum sharing rate of 30 percent of the 
savings. 3 Since the reward is derived from money saved, 
the organization itself realizes a 70-percem savings (less 
program administration costs) and could justifiably in¬ 
crease the amount shared with the employee. 

Managers must make the final decision, keeping in 
mind the best interests of both the organization and the 
employee. However, they should also consider the im¬ 
pact of the size of the sharing rate on other important 
issues, such as improving employee recruitment and 
selection, decreasing absenteeism and turnover, and re¬ 
ducing overtime, all of which traditionally entail high 
administrative costs. 

2 E. C. Shumate, S. L. Dockstader, and D. M. Ncbckcr, 
Performance Contingent Reward System: A Field Study of 
Effects on Worker Productivity, Technical Report 78-20 ISait 
Diego: Navy Personnel Research and Development Center, 
May 1978), AD-A055 796. 

' M. Fein, "Wage Incentive Rians," in II. R. Maynard (ed.), 
Industrial Engineering Handbook, 3rd edition {New York: 
McGraw-Hill 1971). 
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above-standard performance. Although practical cor 
siderations. primarily administrative cost, render 111 
unfeasible, one alternative would be to provide frt 
quern, specific feedback that the employee could reat 
ilv translate into a dollar value. Corollary logic suggest 
that the shorter the time between performance and pot 
itive feedback, the greater the effect upon performance 

Features of a reward system 

A performance-contingent reward system is mo. 1 
adaptable to jobs that have the following chnraetcri* 
tics: 

• The work can be measured objectively. 

• The work is recurring in nature. 

• Satisfactory performance standards can be devel 
oped. 

• The pace of the work is controlled by the individur 
or group. 

• Performance can be directly associated with u spe 
cific individual or group. 

While absolute compliance with these characteristic 
is no! necessary (for example, only 70 percent of tit- 
work on a certain job may be objectively measurable) 
the probability of success is assumed to be directly re 
latcd to the degree of compliance. 

Work measurement system. An objective work mcas 
urement system provides the foundation for any effee 
tivc productivity improvement program. Without ob 
jective measures, managers and supervisors can neithe 
determine the productivity of their employees nor as 
sess the results of any productivity enhancement pro 
gram. An effective work measurement system require 
clearly specified method statements for all measunibh 
tasks, work measures that reflect appropriate job-re 
lated performance, performance standards that ituljcati 
how long it should take to perform the various tasks 
and an information system for collecting, integrating 
and reporting performance data. Work measures an 
useful only to the extent to which they relate to orga 
nizational objectives and are sensitive to changes ii 
individual or group effort. 

Recurring nature of work. The Navy Personnel Re 
search and Development Center conducted a pilot s tilth 




2 aforementioned job characteristics. The opera- 
task was to keypunch information contained on 
jximately 300 different source documents into the 
nrd’s computerized management information sys- 
The source documents were preprinted or hand- 
mi forms that varied in length, format, color, and 
ility. The procedure used to enter each document 
dearly described in a manual available to all key 
operators. Documents arrived in batches from 
sites located throughout the shipyard and were 
d through a control section to the key entry see- 

or to the study, the operators picked up and logged 
own work. Some of them complained that certain 
iduals always picked up the simpler work and left 
nore difficult; understandably, they thought that 
voitld adversely affect their ratings under a per- 
ance-contingent reward system. The problem was 
ved by having the supervisors or their assistants 
bute and log the work, which had the added ad- 
ige of allowing operators to remain at their work 
>ns, thereby reducing nonproductive time. Expe- 
c gained at the shipyard and in subsequent studies 
ales that equitable distribution of work is critical, 
therwise sound program can fail or have its impact 
licantly attenuated if employees perceive that the 
distribution is unfair. 

rjonnance standards. Another crucial element of a 
rd system is the determination of what work level 
be expected of an employee. Such expectations, 
rally referred to as performance standards, icp- 
it a level of performance that warrants a “fair day's 
Technically, a performance standard represents 
amount of time it should take an average, fully 
ed individual to perform a given task using stand* 
>rocedutes under normal conditions. It should be 
hasized that even when standards are developed 
m optimal circumstances, they are estimates or nv- 
cs and consequently subject to error on any given 
)y any given employee. In practice, moreover, per- 
lance standards generally are developed neither 
ir the best of conditions nor by highly trained per- 
lel; therefore, both employees and managers must 
-lop some tolerance for error, 
ost importantly, employees must perceive stand* 
as fair and attainable if the standards are to have 
desired impact upon motivation. If the majority of 


and Development Center researchers is to set or adjust 
standards so that at least the top 30 percent of the work 
force is performing at or slightly above standard prior 
to the introduction of a reward system. Based on the 
adage that “success breeds success," the rule suggests 
that the top performers will he motivated to perform 
at higher rates to cam more bonus money; in turn, the 
remainder of the work force will have reason to believe 
that they can also earn a bonus by improving their per¬ 
formance. Naturally, variations on this rule will depend 
upon local circumstances, such as a supervisor’s knowl¬ 
edge that a majority of the work force is already per¬ 
forming at or near capacity. 

At the Long Beach Naval Shipyard, performance 
standards were developed on the basis of the group's 
average rate for each procedure, expressed in key¬ 
strokes per hour. The degree of accuracy under an av¬ 
eraging method critically depends upon the reliability 
of the performance data; 4 key entry work was chosen 
for the pilot study in part because it yields highly reliable 
data. Rate categories were established by rank ordering 
the 300 procedures according to performance rates and 
dividing the rank order into five distinct ranges (such 
as 5,501-7,500 keystrokes per hour). Five categories 
were selected at Long Beach because the rank order 
produced that many fairly well-defined groupings; how¬ 
ever, there are no established rules for determining the 
number of categories. Each procedure was placed into 
one of the categories and the value of the midpoint of 
that category became its standard. For example, pro¬ 
cedures in the 5,501-7,500 category had a standard of 
6,500 keystrokes per hour. Subsequent to the Long Beach 

1 E. V. Grillo and C J. Berg, Work Measurement in the 
Office: A Guide to Office Cost Control (New York: McGraw- 
Hill, 1959). 
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worn measures, me primary worK measure useu ai 
Long Beach was production efficiency, a summary sta¬ 
tistic that describes a key entry operator’s total pro¬ 
ductivity by combining two efficiency ratios, keystroke 
efficiency and productive time. 

Keystroke efficiency is the ratio of an operator's ac¬ 
tual performance rate relative to the performance 
standard. The performance rate may be variously ex¬ 
pressed, depending upon what is counted (keystrokes, 
records, or batches) and the lime interval of the count 
(minutes, hours, or days). Keystrokes per hour was the 
measure selected at Long Beach because operators were 
familiar with it. Thus, a key entry operator who ex¬ 
ceeded a standard of 6,500 keystrokes per hour by 500 
keystrokes would have a keystroke efficiency rate of 
108 percent on that particular task. 

Productive time is the ratio of the time actually spent 
working to the time assigned to work. On any job, no 
one is going to be productive 100 percent of the time. 
Industrial engineers generally use a 15-percent adjust¬ 
ment that allows for nonproductive activities (such as 
cleaning time and shift changes) and personal time (cof¬ 
fee breaks, social interchange, and so forth). Thus, an 
employee who worked 6.8 hours per day—8 hours less 
15 percent—would achieve a productive time rate of 
100 percent. To exceed the standard, an employee typ¬ 
ically would have to reduce his or her personal time. 

Reporting system. A reporting system for a perform¬ 
ance-contingent reward system should be comprehen¬ 
sive enough to: 

• Capture needed information only. 

• Simplify methods of data collection. 

• Report only information that is meaningful to the 
user. 

• Automate as much as possible. 

In the pilot study, a reporting system was developed 
that identified each operator by an assigned number 
and provided such information as the operator’s shift, 
the procedures performed, performance rates on each 
procedure, and the time taken to complete each pro¬ 
cedure. Tt also calculated keystroke efficiency, produc¬ 
tive time, production efficiency, and incentive bonus 
earnings. The only data the supervisor had to enter 
manually was that indicating the amount of time each 
operator was assigned to a machine. 

All key entry operators received a weekly report which 

' D. M. Nebeker and )■ F. Nocella, Keyprocessing Per¬ 
formance: A Method for Determining Operator Performance 
Standards, Special Report 79-22 (San Diego: Navy Personnel 
Research and Development Center, June 1979). 
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ceived a report with the same information for each op¬ 
erator. 

Payment system. The most significant feature of a per¬ 
formance-contingent reward system is its payment sys¬ 
tem. Of primary concern is correlating the reward with 
performance so that the amount of the bonus is directly 
proportional to the amount of work exceeding the per¬ 
formance standards. 

This can be derived by multiplying four factors: 

• The production efficiency rate, which is the product 
of keystroke efficiency and productive time. (For cal¬ 
culation purposes, this rate is expressed as the propor¬ 
tion exceeding standard performance, or 1.00). 

• The machine time, which is the amount of time an 
operator was assigned to work at the machine. 

• The hourly wage, defined as step 5 of the relevant 
grade level. 

• The sharing rate, which is the percentage of money 
saved that is to be returned to the operators. 

If, for example, a key entry operator had a production 
efficiency rate one week of 125 percent (1.25-1.00), 
worked at a machine for 35 hours, and earned $3.97 
per hour, that person’s bonus for the week would be 
$10.42, assuming a standard sharing rate of 30 percent 
(0.25 x 35 x $3.97 x 0.30 = $10.42). 

Delivery system. Finally, a reward system needs a pro¬ 
cedure for delivering the reward expeditiously. The 
method chosen in the Long Beach study was to allow 
bonus money to accrue until it reached $25 (this figure 
was chosen to reduce administrative costs). When it 
reached that amount, the operator could either with¬ 
draw all or part of the bonus or let it continue to ac¬ 
cumulate. If payment was desired, the supervisor in¬ 
stituted administrative procedures through incentive 
awards channels. Depending upon the submission date, 
the operator received the money from the branch chief 
on the next payday, separate from the payroll check. 

Replication of the pilot project 

An important consideration in evaluating the impact 
of any new management technique is whether the re¬ 
sults will generalize to other work settings. The basic 
concern is whether the results obtained in one study are 
unique to a specific group of people or a certain work 
situation rather than a direct effect of the new tech¬ 
nique. 

Mare Island Naval Shipyard. The key entry section at 
Mare Island was a good candidate for replication pri- 


Officials from the Naval Sea Systems Command were 
sufficiently impressed with the results of the studios at 
the Long Beach and Mare Island Naval Shipyards that 
they asked the Navy Personnel Research and Devel¬ 
opment Center to help implement the system in the 
remaining shipyards. While staffing constraints pre¬ 
cluded the Center's involvement at the same level of 
effort afforded Long Beach and Mare Island, research¬ 
ers were able to develop a viable three-phase plan. 

In phase 1, Center personnel visited the shipyards 
to talk with people who would be involved in the project 
and to describe the basic concept of the performance- 
contingent reward system. In phase 2. shipyard per¬ 
sonnel attended an Intensive two-day workshop at the 
Center in San Diego. Presentations addressed the the¬ 
ory and rationale underlying such elements of the re¬ 
ward system as feedback and recognition as well as 
such practical conslderalions as how to develop stand¬ 


ards and a work measurement system. In phase 3, 
project managers implemented the system. 

Four of six shipyards elected to implement the sys¬ 
tem. Of those four, three sites achieved improved per¬ 
formance. It was speculated that the failure to improve 
at the fourth site was due to an insufficient feedback 
mechanism. Inadequate employee orientation, and an 
impending reduction-in-force. 

The most promising outcome of the project is that it 
demonstrates that federal managers and supervisors, 
with a minimum of professional help, can develop, im¬ 
plement, and administer performance management 
systems that can significantly imptove productivity. The 
Navy has since established a productivity management 
office responsible for developing a system to promul¬ 
gate the transfer of performance technology to inter¬ 
ested managers. That office and the Center are cur¬ 
rently addressing that task. 


manly because the work performed was essentially the 
same and the equipment was nearly identical. Mare 
Island differed in (luce impoitant ways, however: 

• Operators had a dearly established daily produc¬ 
tion standard. 

• Operators were receiving daily feedback about their 
personal peifonmmcc as well as the group's average 
per formanee. 

• Monetary bonuses were issued annually to opera¬ 
tors who exceeded the standard for at least 6 months, 
on the average; however, the same bonus of Slot) was 
given to all operators exceeding the standard, regardless 
of differences in achievement. 

Each of these primary differences is known to have 
a positive motivating effect. As such, it was fell that 
any impiovcment in productivity at Marc Island would 
not only validate the general concepts of the reward 
system, but would also provide some evidence of the 
system's capacity to improve productivity more than a 
system less contingent upon performance. 

The reward system at Marc Island was patterned very 
much after the Long Beach program. The daily standard 
was replaced with performance standards for each pro¬ 
cedure, and the production report was modified to ac¬ 
commodate the same productivity measures used tit Long 
Bench. The only major difference between the two sites 
in terms of work measures was in (lie productive time 
standard: at Long Beach the standard was 6.4 hours: 
at Marc Island it was 7.1 hours. 

Figures 1 and 2 (pp. 40 and 41) reflect the perform¬ 


ance data til each site befoic the introduction of the 
performance-contingent reward system and for more 
than 2 years thereafter, at which point researchers stopped 
monitoring the program. Petfonmmee rale at (he Long 
Beach Naval Shipyard immediately increased by 0 per¬ 
cent and for the most pari remained above the pre- 
reward system level. The decrease in performance in 
the seventh and eighth quarters can he attributed to the 
loss of three high performers, two of whom left because 
of family moves and the other because of a belter job 
opportunity. The significant improvement in total pro¬ 
ductivity is largely due to the increase in productive 
lime; between the first and third quarters, for instance, 
productive time improved by 3H percent. Most impor¬ 
tant from the management point of view, the reward 
system generated enough savings hy the end of the first 
tptarter to defray the total setup costs of the project.'' 

The data from Mare Island invited some interesting 
speculation. While the reward system produced an im¬ 
mediate 11-percent increase in performance rates, those 
rates remained virtually unchanged for 27 months. Ap¬ 
parently, the reward system motivated the operators 
there to reach their maximum performance rates very 
quickly. At Long Beach, on the other hand, the im- 

'• G. hi. fheiton. S. L. Dockstodet, D. M. Nebcker, and fi. 
C. Shumate, A Performance Contingent Reward System that 
Uses Economic Incentives: Preliminary Cost-effectiveness 
Analysis, Technical Report 78-13 (San Diego: Navy Personnel 
Research and Development Center, February IV7H). AD-A050 
830. 



Significant improvements also occurred in the rate of productive time, where the 6.4-hour standard was bettered by 38 percent 
between the first and third quarters, and in production efficiency. Researchers theorized that the productivity improvements were 
a combined effect of operators learning how to work more efficiently and being motivated to do so. 
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provement to maximum performance was much more 
gradual. One might reasonably conclude that the im¬ 
provement in performance at Long Beach involved both 
learning how to work at a higher rate and being mo¬ 
tivated to do so, whereas the employees at Marc Island 
already knew how to perform at a high rate due to the 
feedback mechanism and the incentive system in op¬ 
eration there. The existing system had reached its ca¬ 
pacity to increase performance; the new reward system 
simply tapped more performance potential. 

Finally, it should be noted that a direct comparison 
of performance measures between Long Beach and Mare 
Island is valid only for performance rate. Because man¬ 
agers at Marc Island decided to require their operators 
to work at their machines approximately 40 minutes a 
clay longer than did managers of operators at Long 
Beach, it was very difficult for the Mare Island workers 
to surpass the 100-percent level for productive time. 
Nonetheless, improvement in performance at both sites 
was such that the effectiveness of each organization— 
ns measured by cost per keystroke—was highly com¬ 


parable 6 months after the programs were imple¬ 
mented. 

It is encouraging to note the increasing awareness by 
government managers of the value of recognition in 
motivating employees. Attesting to this increased 
awareness are policies to integrate pay with perform¬ 
ance and to decentralize the administration of the in¬ 
centive awards program. 

The favorable results of the studies at Long Beach 
and Mare Island Naval Shipyards have been instru¬ 
mental in changing the incentive awards policies of both 
the Department of the Navy and the Office of Personnel 
Management. The Navy’s new Productivity Improve¬ 
ment Awards Program and OPM’s proposed Produc¬ 
tion Awurd System are based upon the same principles 
as those of the performance-contingent reward system.’ 
In addition, the Defense Department has a proposed 
i nstruction und er review that is directed towards im- 

7 .See, respectively, Appendix F to Civilian Personnel In¬ 
struction 451, July I, 1982, and the proposed change to Chapter 
451 of the Federal Personnel Manual. 



supervisors prior to tne iniroauction ot the performance-contingent reward system. Thus although their performa^- 
immediately increased by 1t percent under the new system, over time their rates of performance productive time Itheir 
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proving productivity not only through capital invest¬ 
ment in new equipment and advanced technology but 
also through programs designed to increase work force 
motivation.” Specifically, the proposal states that man¬ 
agers and supervisors should, among other things, adapt 
trial applications of proven and promising motivation 
techniques to individual work situations. Successful 
programs would be documented, tailored to similar work 
situations, and adopted as widely as possible (see bo,\ 
on p. 39 for one example). 

It is also wort!) noting that the performance-contin¬ 
gent reward system was designed as a positive program 
for performance improvement. Study participants were 
never told to increase their performance. If they chose 
to perform above standard, they received a bonus; if 
they chose not, there were no penalties other than those 
normally in force. Experience suggests that, because 
the proportion of poor performers is so small in most 
organizations and the potential gains are so great, man- 

8 Proposed DoD instruction 50iO. XX, Work Force Moti¬ 
vation. 


agers need to accent the positive and minimize the : 
alive. DMJ 


E. CHANDLER SHUMATE serves u\ the r 
director of performance management systems at tii< \ 
Personnel Research and Development Center u. 
Diego, California. He received his doctorate tit « v, 
mental psychology from the University of Aeu Mt \ 

STEVEN L. DOCKSTADER serves as the re¬ 
director of industrial management and milium pu 
edness at die Navy Personnel Research and DeveL>; 
Center. He received his doctorate in experimental 
chology from the University of Denver. 

DELBERT Af NEBEKER is an associate pr-->u 
of management at San Diego State University lit 
serves as manager of the productivity and incentne 
tiremem facility at the Navy Personnel Research 
Development Center. He received his doctorate r; 
ganizational psychology from the University ui U 
ington. 









oiiaiiiitj iiuiiicxii micmyciiuc 

through a computer network 

By ROBERT J. KNEZ 

Consultants Anonymous, a proposed organization of multidisciplinary 
subscribers to a time-shared computer system , could be an effective tool 
in retaining this country's preeminence in technological development 


I n his book The Third Wave, Alvin Tofflcr wrote about 
the two great waves of change that the human race 
l>as undergone: the agricultural revolution, which oc¬ 
curred over thousands of years, and the industrial rev¬ 
olution, which took 300 years. Toffler also postulated 
a third wave, now under way, which will complete its 
sweep in only a few decades. The key to this third wave 
is the emergence of the computer and the impact of 
that phenomenon on society. 

The premise of this article is that the third wave may 
be this nation's most effective tool for maintaining our 
technological advantage over potential adversaries.* 
While our leadership is presently taking steps to stem 
the ongoing transfer of technology—both legal and 
clandestine—to such countries, perhaps the best way to 
safeguard the balance of power is by simply staying 
ahead of the competition. 

One way to do so is by promoting the pollination of 
ideas across subject disciplines via a time-shared com¬ 
puter network. Although previous implementations of 
Such systems have been restricted to a small group of 
Professionals working on prespecified, often esoteric 
Problems, there is no practical reason for not making 
*1 time-shared system available to a much wider variety 
^f military and civilian personnel for day-to-day use in 
Problem-solving. 

“Consultants Anonymous,” the name used in this 
^rticle to identify such a computer network, ideally would 
implemented using an existing time-sharing system. 
Numerous automated information systems are currently 

* This article is adapted from Robert J. Knez, Mutual Prob¬ 
lem Solving Through Computer Time Sharing (Carlisle liar¬ 


providing such services as bibliographic search, tech¬ 
nical information retrieval, and electronic mail; by mak¬ 
ing Consultants Anonymous part of such a system, a 
subscriber could readily switch from one service to an¬ 
other. Predictably, equipment acquisition could also be 
minimized in this way. 

The basis for Consultants Anonymous is the Craw¬ 
ford Slip Method, developed by C. C. Crawford in 1923. 
The method derives from Crawford’s practice of giving 
3" x 5" slips of paper to an audience and asking them 
to provide their solutions to a precisely targeted prob¬ 
lem. In effect, the method generates innovative think¬ 
ing and captures unrecorded know-how while relieving 
the audience’s inhibitions through anonymity. Accord¬ 
ing to Crawford, the psychological benefits gained from 
combining brainpower include bolstering courage, sub¬ 
dividing large projects, gathering raw material for 
thought, adding fractions of know-how, structuring the 
composite, diagnosing problem situations, building con¬ 
sensus toward remedies, forecasting acceptance of rem¬ 
edies, and improving implementation. 

As such, Consultants Anonymous would be partic¬ 
ularly useful to managers who work in subject areas 
that are as yet largely undocumented and who analyze 
problems that arc massive in scope. For example, a 
project planner might be faced with the task of verifying 
the completeness of an activities list anil the sequence 
of execution before a project’s cost can be estimated 
and a completion date projected. Activity lists can con¬ 
sist of hundreds of events, and omission of a single 
critical event can cause severe problems. But a com¬ 
munity of multidisciplinary subscribers such as Con- 




and identify related activities that perhaps went unrec¬ 
ognized by the planner. 

T he variety of potential problems that the system 
could take on is virtually unlimited. These might 
include: 

• What is the greatest security threat facing the U.S. 
in Asia today? (Addressed to military officials.) 

• I am having difficulty in getting release 36 of Cor¬ 
poration Y's operating system to work. It will not al¬ 
locate disk space properly on model Z disk drives. Has 
anyone else had a similar problem with this release? 
(Addressed to an association of computer users.) 

• I am developing a PERT network for the design, 
development, and implementation of a new manufac¬ 
turing ptocess for widgets. Please recommend proper 
sequencing and identify any missing critical events from 
the following list. (Addressed to manufacturers and 
managers.) 

Moreover, the simplicity of the Crawford Slip Method 
makes it an ideal choice for automation. No preplanning 
or fonnal gathering of a problem-solving group is nec¬ 
essary. A person with a problem to submit would key 
in the problem, identify the target audience, and specify 
a time or a number limit on responses. If there were 
responses, the submitter could ask to see them in chron¬ 
ological or alphabetical order, by discipline of the re¬ 
sponder, by keyword, or in some other computer-com¬ 
patible order. Meanwhile, the submitter might be 
informed that another submitter had requested similar 
assistance from subscribers in his or her professional 
discipline or association. 

No submitter would be obliged to review and re¬ 
spond; however, submitters who had received helpful 
responses to their own problems would probably do so. 
Before signing off, the submitter could notify the system 
that one or more respondents had provided exception¬ 
ally useful solutions. Through a special construct called 
a ''stroke,” a thank-you note could be sent to the re¬ 
spondent and a permanent record made to reflect that 
person's contribution to the system. 

Of course, the real value of such a system will be 
evident only when it is widely used. If it is not. it will 
rapidly approach complete disuse; but if it provides a 
useful service, the demand for that service should rise 
toince tli limits of the service. This in turn necessitates 


of Consultants Anonymous as only one node in a net¬ 
work of Consultants Anonymous systems. 

Naturally. Consultants Anonymous must be easy to 
use. It must also be cost-effective in terms of its users’ 
personal time, and the users must be able to recognize 
this advantage. It is important to assure people, par¬ 
ticularly busy executives, that such a system can fre¬ 
quently be more effective than conventional face-to- 
face and telephone communications because of its easy 
accessibility to large audiences. 

Still, human beings, the real resource in Consultants 
Anonymous, will not remain satisfied for long in an 
anonymous and unrewarded state. To satisfy the basic 
human need for recognition. Consultants Anonymous 
must contain some sort of status system. Perhaps titular 
degrees such as Associate, Expert, and Master could 
be bestowed based on the significance and frequency 
of the subscriber's contributions. As sufficient '‘strokes” 
were received, the contributor's degree status would be 
elevated. And if the system proved to be especially 
useful, monetary awards might also be considered. 

To maintain the cohesiveness of the diverse users, 
Consultants Anonymous could publish a weekly or 
monthly video newsletter. This publication could pub¬ 
lish letters from members, show examples of good prob¬ 
lem submittals and responses, explain new system fea¬ 
tures. recognize members whose status has been elevated, 
and so forth. It could also serve as a vehicle for sub¬ 
scribers to express their feelings about the system’s op¬ 
eration and to collect suggestions for improvements. 

In this age of the “third wave,” computer system 
applications such as Consultants Anonymous seem both 
inevitable and sensible. Corporations and nations that 
accept and learn to harness this wave of change will 
emerge or remain ns leaders of industry and the world. 
If the United States is to maintain its technological lead¬ 
ership and thereby assure its economic stability, it must 
not shrink from this task of gathering intelligence and 
distributing it through the power of the computer. 

_ QSAi 

ROBERT J. KNEZ is director of automatic clata- 
processing systems at the Defense Technical Information 
Center, Alexandria, Virginia. He mis previously deputy 
director of data systems at the Defense Electronics Sup¬ 
ply Center, Dayton, Ohio. A 1982 graduate of the U.S. 
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